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PERSONALITY FACTORS AMONG SCIENCE AND 
TECHNOLOGY FRESHMEN’ 


EUGENE B. NADLER 
Case Institute of Technology 


In spite of numerous criticisms of 
the concept of personality types, ably 
summarized by Hilgard (1957, pp. 
485-488) , the notion has proved useful 
in psychology and anthropology un- 
der the names of syndrome, life style, 
basic personality structure, modal 
personality, ete. (See Inkeles & Lev- 
inson, 1954, for example). The study 
reported here had as its starting point 
such a conception, one which could be 
used to differentiate among freshman 
students in of and 
technology. 

The focus was upon two dichoto- 
distin- 
222- 


a school science 


mous personality variables 
guished by Murray (1938, pp. 
223), Extraception-Intraception and 
Exocathection-Endocathection. The 
first refers to the direction of the per- 
son’s interest, outward inward, 
while the second refers to its objects, 
things, or ideas. Taking all combina- 


or 
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of on curriculum evaluation 
ported by a grant from the Carnegie Cor- 
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The authors gratefully acknowledge the 
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of the data and to Morrell Heald for his 
cooperation in the administration of the 
questionnaires. The opinions expressed 
herein are the authors’ 
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tions of both the direction and the ob- 
ject of interest led Murray to describe 
the following four types: 

1. Extraception-Exocathection: To 
adapt to the world as it stands; to be 
interested in tangible results; to be 
very practical; to amass a fortune. To 
secure a permanent position; to be- 
come a member of clubs and institu- 
tions; to be without illusions; to con- 
serve established values. To work 
effectively with mechanical appliances. 

2. Intraception-Exocathection: To 
live imaginatively; to dramatize the 
self; to express one’s sentiments and 
beliefs in action. To initiate and fur- 
ther progressive social movements. To 
speak against abuses; to propose re- 
forms. To concoct new schemes, busi- 
ness ventures, political innovations; 
to be guided by a vision of the future. 
To seek adventure; to become involved 
in amorous affairs. 

3. Extraception-Endocathection: To 

interested in ideas and theories 
about substantial events (for example, 
physical sciences). To reflect and write 
about external occurrences and sys- 
tems; history, economics, government, 
education. To collect data and think 
inductively. 

4. Intraception-Endocathection: To 
devote oneself to artistic or religious 
representations. To dream, brood, and 
introspect; to become absorbed in the 
attempt to resolve inner conflicts and 
spiritual dilemmas. 


be 


293 
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The study was concerned with the 
following tasks: 

1. testing the hypothesis that signifi- 
cant numbers of students in the school 
would fall into the two extraceptive 
categories, and very few into the two 
intraceptive categories 

2. placing the predicted finding in a 
broader societal context by determin- 
ing what socioeconomic influences, if 
any, might be reflected in the two 
varieties of extraception 

3. describing further the differences 
between the extraceptive students who 
were exocathecting on the one hand 
and endocathecting on the other in 
terms of their career goals and life val- 


ues 

4. examining the influence of these 
orientations on the students’ evalua- 
tion of their courses and curricula, and 
on their academic performance 


METHOD 


Differentiating the types. The following 
questions were included as part of a larger 
questionnaire’ presented to 432 male fresh- 
men about three-quarters of the way through 
their first semester: 

1. Once in my life I would like to: a 
develop a valid scientific theory, b. dis- 
cover a satisfactory principle of ethical 
conduct, c. invent a marketable product, 
d. convince a legislature to enact one of 
my views into law. 

2. I would like a job where: a. I could 
express my social views through my work, 
b. I could organize the thinking in my 
field in a systematic way, c. I could dis- 
cover my true potentialities, d. I could do 
work of practical importance 

3. I am filled with awe when I consider 
the lives of: a. Vincent Van Gogh, Ma- 
hatma Gandhi, Albert Schweitzer; b 





*A copy of this questionnaire has been 
deposited with the American Documentation 
Institute. Order Document No. 6834 from 
ADI Auxiliary Publication Service, Library 
of Congress; Washington 25, D. C., remit- 
ting in advance $2.00 for microfilm or $3.75 
for photocopies. Make checks payable to: 
Chief, Photoduplication Service, Library of 
Congress 
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Charles Kettering, Andrew Carnegie, 
Winston Churchill; c. Louis Pasteur, 
Woodrow Wilson, Abraham Lincoln; d. 
Frank Lloyd Wright, John Dewey, Albert 
Einstein. 

4. In my spare time I would like to: a. 
teach woodcraft to a Boy Scout troop, b. 
participate in a campaign for better 
schools, c. discuss and evaluate different 
political systems, d. learn about psycho- 
analysis 

5. Everyone is a little of everything, but 
by and large, I am mostly: a. practical, 
b. idealistic, c. thoughtful, d. sensitive. 

For every question, each of the four al- 
ternatives corresponds to one of the four 
personality types. If in answering the five 
questions a student chose three or more al- 
ternatives characteristic of a single type, 
he was placed in that type. The chance 
probability of this happening was p = .10, 
calculated by collecting the first three 
terms of the binomial expansion (4% + 
%)*. 

Questionnaire. The same questionnaire 
included a large number of items which 
covered the general areas of social class 
background, career goals and life values, 
and evaluation of curricula and courses. 

Academic performance. At the end of the 
first freshman semester, two measures of 
achievement became available, grade point 
averages and the number of separations 


RESULTS 


Of the 432 students surveyed, 143 
or 35% were classed as Extraceptive- 
Exocathecting, and 83 or 19% were 
classed as Extraceptive-Endocathect- 
ing. Only 15 men fell into the In- 
traceptive - Exocathecting category 
(3.4%), and only 9 into the Intracep- 
tive-Endocathecting category (2.1%). 
The miscellaneous or mixed group 
(those with fewer than three responses 
in their largest category) consisted of 
182 individuals, comprising 42% of the 
sample. Thus, the two Extraceptive 
groups who were predicted to make 
up a significant proportion of the sam- 
ple together accounted for about 52% 
of the subjects, with only insignificant 
numbers in the Intraceptive categor- 
ies. The rest of this report will be 
solely concerned with the two sub- 





PERSONALITY FACTORS 


groups among the Extraceptive men, 
the Exocathecters and the Endo- 
cathecters, who will be referred to as 
the practical men and the theoretical 
men, respectively, for convenience and 
descriptive simplicity. 


Social Class Background 

The responses of the subjects to a 
question dealing with their fathers’ 
occupations at the time of their birth 
(about 1940) and to one dealing with 


their fathers’ oecupations at the time 


of taking the questionnaire (early 
1959) were sorted into the following 


categories: (a) unskilled, semiskilled, 


farm: (b) skilled; (c) foremen; (d) 
white collar, sales, government, mili- 
tary; (e) subprofessional; (f) entre- 


preneurial; (g) professional. Table |! 
shows the percentage distributions of 
each group of fathers at the two times. 

The chi square test of independence 
between the two distributions, 
tical versus theoretical fathers in 1940, 
was 15.97, significant at the .02 level 
The differences between the two dis- 
tributions were due to the higher pro- 
portion of unskilled, semiskilled, farm 
workers, and foremen among the fa- 
thers of the practical men, and the rel- 
atively higher proportion of white col- 
lar, government, and military 
workers among the fathers of the theo- 
retical men. 

The distributions of fathers’ occu- 
pations were still significantly differ- 
ent in 1959, chi square being 84.50, 
significant beyond the .001 level. 
However, the major difference here 
was due to the larger proportion of 
entrepreneurs among the fathers of 
the theoretical men 

Comparing each group with itself 
at the two different times showed a 
major shift among the practical fa- 
thers from unskilled, semiskilled, and 
farm in 1940 to white collar, sales, 
government, and military occupations 


prac- 


sales, 


TABLE | 


FATHER’s OCCUPATION AT DIFFERENT TIMES 


Practical | Theoretical 
men men 


Father’s occupation 


Unskilled, semiskilled, 
farm 

Skilled 

Foremen 

White collar, sales, gov 
ernment, military 

Subprofessional 

Entrepreneurial 

Professional 


Chi square comparisons 
Practical vs. theoret 
ical 1940 
Practical vs 
ical: 1959 
Practical: 1940 vs 
1959 
Theoretical 
1959 


theoret 


1940 vs 


in 1959; the chi square between the 
1940 and 1959 distributions was 18.56, 
significant beyond the .01 level. The 
fathers of the theoretical men, on the 
other hand, showed a major increase 
in the entrepreneurial category; the 
chi square of 11.16 was not significant, 
but was close enough to significance 
slight trend, p 
about .07. It is interesting that the 
occupational distribution of the fa- 
thers of the practical men in 1959 is 
almost identical with that of the fa- 
thers of the theoretical men in 1940. 
There were no significant differences 


to indicate a being 


in fathers’ incomes between the two 
and the 
the responses on questions 


groups, omission of almost 
40% of 
dealing with parental education in- 
validated any conclusions that might 


have been drawn from these data 
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Career Goals and Life Values 


In order to analyze the curriculum 
choices of the students, the school cur- 
ricula were divided into science and 
engineering. The one curriculum which 
did not fit into either category, man- 
agement, was safely excluded since 
only one practical man and one theo- 
retical man chose it. The science cur- 
riculum comprised math, physics, 
chemistry, and engineering science. 
The engineering category included 
metallurgical, civil, chemical, elec- 
trical, and mechanical engineering. In 
this way a two by two table was con- 


TABLE 2 
CHARACTERISTICS OF JOB AND Lire GOALS 
CHOSEN AS IMPORTANT 


Theo 
retical 
men 


Practi- 


Characteristic of life goal 
_ f life go cal men 


Ideal job 
Management 
Equipment design 
Graduate school 
Characteristics of ideal job: 
Use of special abilities 
High income 
Opportunity for creativity 
Freedom from supervision 
Ideal position at peak of 
career: 
Science 
Administration 
Teaching 
Personal characteristics 
thought important: 
To be liked by people 
To understand other people 
grounding in basic 
theory 
Practical knowledge of facts 
Ability to convince and 
persuade 
Organizing and 
trative ability 
Activities expected to give the 
most satisfaction: 
Career 
Family 
Community and organiza- 
tions 


Good 


adminis- 
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structed with personality type, prac- 
tical or theoretical, on one margin, and 
curriculum choice, engineering or sci- 
ence, on the other. The chi square was 
59.24, significant beyond the .001 level. 
Eighty-four percent of the practical 
men had chosen engineering, 16% sci- 
ence, as opposed to 67% of the theo- 
men who had chosen sci 
and 33% engineering. 

The distribution of choices of the 
ideal job upon graduation for the prac- 
tical men was significantly different 
from that of the theoretical men, chi 
square being 41.25, significant beyond 
the .001 level. The order of choices for 
the practical men was graduate school, 
management, equipment design, ap- 
plied research, new product develop- 
ind bringing up the distant rear, 
basic research, production, sales, and 
teaching. The order of choices for the 
theoretical men was graduate school 
first, and all other alternatives far be- 
hind 

The requirements of the ideal job 
also differentiated the two groups. Out 
of a list of 10 possible requirements of 
| job which were checked for 
“high” priority, four items discrimi- 
nated between the two groups, the 
probabilities ranging between .05 and 
001. Among the practical men it was 
more important to earn a good deal of 
money, whereas among the theoretical 
men it was more important to have 
the opportunity to use their special 
abilities and aptitudes, to be creative 
and original, and to be relatively free 
of supervision by others. Out of the 
same list which was rechecked for 
items having “medium” priority, five 
items separated the groups, the prob- 
abilities ranging between .05 and .02. 
Among the practical men it was mod- 
erately important to have the oppor- 
tunity to use their special abilities and 
talents, to be creative and original, 
and to exercise leadership, whereas it 


retical 


ment 


the idea 
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was moderately important for the the- 
oretical men to have a chance to earn 
a good deal of money and to look for- 
ward to a stable, secure future. 

Responses to a question about the 
occupational positions which would be 
ideal at the peak of their careers were 
classified into categories of scientific, 
administrative, ownership, teaching, 
and other and don’t know. The chi 
square test of independence between 
the two distributions was 78.17, sig- 
nificant beyond the .001 level. Among 
the practical men the order of choices 
was administrative, scientific, owner- 
ship, and teaching. Among the theo- 
retical men this order was scientific, 
administrative, teaching, and owner- 
ship. 

The personal characteristics which 
the two groups perceived as promoting 
vocational success also showed some 
differences. Of 17 items checked as es- 
sential to vocational success, six dis- 
tinguished the two groups at probabil- 
ity levels ranging from .05 to .01. The 
practical men felt it important to be 
liked by people, to understand other 
people, to be able to convince and per- 
suade other people, to have practical 
knowledge of the facts in one’s field, 
and to have organizing and adminis- 
trative ability. The theoretical men 
more often felt it necessary to have a 
good grounding in basic theory. 

A short series of four questions deal- 
ing with the importance of planning 
for the future, getting ahead in life, 
knowledge of one’s academic per- 
formance in comparison to others, and 
choosing among being successful, in- 
dependent, or well liked showed one 
significant difference between the two 
groups, significant at the .01 level. 
The practical men preferred success 
to independence, and independence to 
being well i‘ked, whereas the theoreti- 
cal men preferred independence to suc- 
cess, and success to being well liked. 


The activities which were expected 
to give the most satisfaction in life 
showed the practical men overwhelm- 
ingly making family relationships a 
first choice, followed by career ac- 
tivities and leisure time activities. The 
theoretical men were about evenly di- 
vided between family relationships 
and career activities, with some senti- 
ment for activities directed toward 
national and international betterment, 
and church activities. The chi square 
between the two distributions was 
17.74, significant beyond the .01 level. 


Evaluation of Curricula and Courses 


In 5 out of 13 ratings describing the 
nature of the ideal curriculum, the 
two groups presented different con- 
ceptions; four of these differences were 
significant beyond the .001 level and 
one at the .01 level. The practical men 
thought the ideal curriculum should 
emphasize practical aspects of the ma- 
terial, relate directly to the kind of 
work they would be doing, emphasize 
facts and techniques that have direct 
application, leave enough free time for 
other activities, and prepare them for 
taking responsibilities in management 
and administration. The theoretical 
men thought that the ideal curriculum 
should be mostly concerned with 
theory, provide them with a broad 
and general knowledge of the field, 
emphasize the ability to think logi- 
sally and abstractly, be difficult 
enough to require real effort, and not 
have to prepare them for taking re- 
sponsibilities in management and ad- 
ministration. 

Two out of 13 ratings describing 
what the students realistically ex- 
pected of their curricula distinguished 
the two groups, one being significant 
at the .001 level and one at the .01 
level. The theoretical men expected 
their chosen curriculum to be mostly 
concerned with theory, but did not 





EUGENE B. NADLER AND GILBERT K. KRULEE 


TABLE 3 
Ratines or Items RELATING TO 
THE CURRICULUM 


MEAN 


Theo 
retical 
men 


Practi 


> s 
Item cal men 


The ideal curriculum should 

1. be mostly coneerned 
with theory (1)> 
emphasize practieal as 
pects (3) 

2. provide broad knowl 
edge (1) ' 
relate directly to future 
work (8) 

5. emphasize the ability 
to think (1) 
emphasize facts 
techniques (8) 

6. require real effort on 
my part (1 
leave me with free time 
(8 


and 


10. prepare me for man- 
agement (1 
not prepare me for 
management (5 
My realistically expected 
curriculum would 
1. be mostly concerned 
with theory (1) 
emphasize practical ap 
plications (8 
10. prepare me for manage 
ment (1 
not prepare me for 
management (8 
In my least valuable course 
1. practical applications 
are emphasized (1 
the primary emphasis 
is on theory (8) 
3. students influence what 
is discussed (1) 
instructor 
what is discussed (8 
. the instructor is im 
partial (1) 
the instructor is not 
impartial (8) 


decides 


* All items are paraphrased 
> Numbers in parentheses are the extreme 


values 


expect it to prepare them for taking 
on responsibilities in management and 
administration; the opposite was true 
of the practical men. 


Neither the nominations for the 
most valuable course, nor the descrip- 
tive ratings of the most valuable 
course distinguished the practical men 
from the theoretical men. 

On the other hand, the nominations 
for least valuable course were differ- 
ent for the two groups, the chi square 
of 12.926 having a probability of less 
than .05. Whereas 44% of the theo- 
retical men nominated graphics as the 
least valuable course, only 17% of the 
practical men did. On the other hand, 
30% of the practical men chose chem- 
istry as their least valuable course, as 
opposed to 24% of the theoretical men. 
Other courses were chosen with equal 
relative frequency by both groups. In 
3 out of 14 ratings describing the least 
valuable course, the two groups pre- 
sented different evaluations, each sig- 
nificant beyond the .005 level. The 
theoretical men described their least 
valuable course as primarily empha- 
sizing practical aspects of the material 
and were more vehement in expressing 
the idea that the instructor did not 
allow the students to decide what to 
discuss in However, they also 
felt he was more impartial in dealing 
with individual students than did the 
practical men. 


class. 


Academic Pe rformance 

The grade point average of the prac- 
tical men at the end of the first semes- 
ter was 1.034 on a 3-point grading sys- 
tem which included 2 negative quality 
points for F. The average of the theo- 
retical men for the same period was 
1.378. The difference between these 
two means was significant beyond the 
.01 level for a two-tailed test, t being 
2.991. 

Since it was possible that the ob- 
tained difference in school achieve- 
ment was due to differences in scholas- 
tic aptitude between the two groups, 
they were compared with respect to 
their performance on two tests of the 





PERSONALITY FACTORS 229 


College Entrance Examination Board 
required of all freshmen. There was 
no significant difference between the 
two groups on the Math Aptitude test. 
On the Verbal Aptitude test, the theo- 
retical men scored slightly higher than 
the practical men; ¢ was 1.83, signifi- 
cant at the .05 level for a one-tailed 
test but not for a two-tailed test. Thus, 
there was only weak support at best 
for the notion that the higher achieve- 
ment of the theoretical men was due to 
higher college aptitude. 

There was no significant difference 
in separations between the two groups 
at the end of the first semester, the 
percentage being 22% for the practical 
men and 20% for the theoretical men. 
However, on the hypothesis that per- 
sonality compatibility or ego syn- 
tonicity (see Levinson, 1959) might 
play a role in the separation rate, the 
subjects were divided between those 
who had made compatible choices and 
those who had not. Practical men who 
chose engineering curricula, or theo- 
retical men who chose science curricula 
were considered to have made com- 
patible choices; practical men who 
chose science, and theoretical men who 
chose engineering were considered to 
have made incompatible choices. Of 
174 men who had made compatible 
choices, 30 or 17% were separated at 
the end of the first freshman semester. 
Of 50 men who had made incompatible 
choices, 17 or 34% were separated at 
the end of the first freshman semester. 
The difference between these propor- 
tions was significant beyond the .01 
level. 


DISCUSSION 


The major differences between these 
Extraceptive freshmen may perhaps 
be best understood in terms of the 
social psychological concepts of status 
anxiety and status security. The pat- 
tern of responses to the questionnaire, 
and especially the data on father’s oc- 


cupation, suggests that the practical 


men were relatively more anxious 
about their status, while the theoret- 
ical men were relatively more status 
secure. The orientations of the prac- 
tical men tended to serve the ends of 
upward status mobility in modern in- 
dustrial society; those of the theoret- 
ical men gave greater personal and 
horizontal mobility. The courses and 
curricula of the school were evaluated 
in terms of whether they met the re- 
quirements of these orientations. 

In the days when the differences be- 
tween science and engineering were 
sharp and clear these orientations 
might have had approximately equal 
viability. Boys who liked to work with 
their hands could go into engineering; 
thoughtful boys could go into science. 

The trend in recent years, however, 
has been for the engineering curricula 
to become more like the science cur- 
ricula, to emphasize basic scientific 
principles and broad theoretical skills. 
The first year curriculum facing the 
students in this study had this marked 
theoretical character, and was identi- 
eal for all of them. As such, it was less 
ego syntonic for the practical men 
than for the theoretical men, which 
probably accounts for the lower grade 
point average of the practical men at 
the end of the first semester. 

In the first year, all the practical 
men faced a program that was not ego 
syntonic. However, for those who had 
chosen an engineering curriculum, the 
first year was at least a stepping stone 
to a program that was more compat- 
ible with their needs. No such hope re- 
mained for those practical men or 
those theoretical men who had made 
incompatible curriculum choices, since 
the feedback from upperclassmen and 
faculty members regarding the nature 
of the second, third, and fourth year 
programs could only increase the con- 
flicts arising from their incongruous 
decisions. Thus, at the end of the first 
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freshman semester, those who had 
made incompatible curriculum choices 
had double the separation rate of those 
who had not. 

What practical recommendations 
may be made from these considera- 
tions? 

In general, the specific reeommenda- 
tions tend to fall under two main head- 
ings: (a) techniques designed to help 
students make ego syntonic choices at 
the outset, and (b) techniques de- 
signed to make it easier to change 
from an incompatible program to one 
that is compatible. 

The present state of personality 
measurement probably does not per- 
mit that the research tool used here to 
classify freshman subjects could also 
be used to select prospective freshmen, 
even if it were greatly improved. On 
the other hand, such an instrument 
would have great value in aiding the 
preliminary counseling of freshmen. 
Although the subjects of this study 


were not required to declare a choice 
of curriculum until the end of the first 
year, and had an opportunity to re- 


vise this choice even afterward, it is 
clear that sometime during the first 
semester most of the students had 
made a fairly binding decision, since 
almost all of them answered the ques- 
tion on curriculum choice, whereas 
other questions went unanswered. A 
guidance instrument would prove of 
value in clarifying for the student the 
consequences of given curriculum de- 
cisions, and could aid in reversing 
seemingly binding decisions which 
were incompatible with the student’s 
interest. 

As a further way of improving the 
initial choices of freshmen, the pub- 
licizing departments of technical 
schools could step up a campaign to 
present a more realistic picture of what 
a modern technical program entails, 
focusing on the emphasis on theoret- 
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ical skills. The present.study indicates 
that, by and large, there is a great deal 
of self-selection in the students who 
come to a technical school, and that, 
by and large, this self-selection is 
highly realistic. An informative pub- 
licizing campaign could improve an 
already effective self-selection system. 
It also might have the effect of attract- 
ing students who might otherwise in- 
vest their energies elsewhere, thus in- 
fluencing another side of the selection 
process. 

There remains the problem of 
changing incompatible choices once 
they have been made. Our impression 
is that the student’s decisions have 
been accepted by members of his fam- 
ily and his friends to a high degree, so 
that part of his identity has come to 
rest on the expectations that he has 
induced in others. It would appear to 
be desirable for the school to counter 
this social support, to create a climate 
in which indecision, hesitancy, and 
ambivalence about curriculum is tol- 
erated, in which shopping around is 
encouraged, and in which curriculum 
choices may be more easily postponed 
or changed. 

A second recommendation which at- 
tacks this same problem is one which 
is already being carried out in some re- 
spects. With the breakdown of the 
traditional boundaries between science 
and engineering in the working world, 
there is some tendency for a greater 
number of course choices to be offered 
the student, thus increasing the possi- 
bility of accommodating both practical 
and theoretical interest patterns 
within the same department. 

SUMMARY 

Measuring Intraception-Extracep- 
tion and Exocathection-Endocathec- 
tion in the freshman class at a school 
of science and engineering showed al- 
most no Intraceptive persons present. 
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The Exocathecting men tended to 
choose engineering as a major field of 
study, were oriented toward the appli- 
cation of social skills in managerial 
and administrative occupations as 
means of achieving money and success, 
and perceived family relationships as 
bringing satisfaction in life. The En- 
docathecting men tended to choose 
science as a major field of study, were 
oriented toward utilizing theoretical 
skills in graduate school and scientific 
occupations as means of achieving 
self-actualization, and perceived fam- 
ily and career activities as jointly 
bringing satisfaction in life. In general, 
the Exocathecting men seemed more 
anxious about their social status than 
the Endocathecting men. Compatibil- 
ity between personal needs and objec- 
tive features of the school situation 


was seen as a major factor in the 
higher grade point average of the En- 


docathecting men, and in the lower 
separation rate of those students who 
had made ego syntonic curriculum 
choices. Some practical recommenda- 
tions stemming from these findings 
were briefly discussed. 
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THE DRAW-A-MAN TEST IN INDONESIA’ 


> 
‘ 


R. MURRAY THOMAS 
University of California, Santa Barbara 

Indonesia, a nation of perhaps 90 
million people, has no standardized 
intelligence scale. This state of affairs 
is the result of a variety of factors, in- 
cluding a dearth of trained test con- 
structors, the existence of many dif- 
ferent languages in the nation, and the 
impossibility of establishing accurate 
birthdates for many subjects who 
might form a standardization group. 

In trying to provide a temporary 
instrument to use with children until 
an adequate test is developed, the 
writers tried the Goodenough Draw- 
A-Man scale on a sample of 1,245 
children in Bandung, a modern city of 
about one million inhabitants in the 
mountains of West Java 

The results of this study are re- 
ported here as: (a) a comparison be- 
tween the success of the Indonesian 
children and the success of the Ameri- 
can children in Goodenough’s original 
standardization group to discover 
whether American standards for the 
test should be transferred directly for 
use in Indonesia, (6) correlations be- 
tween the Indonesian children’s Draw- 
A-Man scores and their teachers’ rat- 
ings of their general intelligence, and 
correlations between the Indo- 
nesian pupils’ Draw-A-Man scores 
and their marks in several school sub- 
jects to discover whether the test cor- 
related with achievement in school 
subjects. 


(c) 


* This carried out under 
teacher education project of the State Uni- 
versity of New York financed by the Ford 
Foundation. The aid of Winarno Surachmad 
and research assistants Soeparman, Mariani 


Hutabarat grate- 


study was a 


18 


Azis, Suharsini, and S 
fully acknowledged 
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Universi Bai 


METHOD 
Subjects 


The 1,245 children were drawn from 
639 children from five 


enrolling 


three sources: 


public elementary schools 


Grades 1-6, 524 childen from five pri- 
vate schools enrolling Grades 1-6, and 
82 children from three private kinder- 
gartens (there are no public kinder- 


gartens). 

The schools were selected by ran- 
dom sampling techniques from the 
Bandung district, and every child in 
class the days of the testing (late 
spring 1960) was included. In the final 
compilation of data 109 children were 
eliminated from the sample because 
their birthdates could not be estab- 
lished, and 28 were eliminated because 
they drew women or included cars or 
boats instead of drawing only a man. 
This reduced an original sample of 
1,382 to a usable sample of 1,245. 

The nation’s ideal of compulsory, 
universal education has not been 
realized, primarily because of a short- 
age of school buildings. Thus not all 
Bandung children attend school. An 
inspection of the occupations of the 
fathers of school groups like this sam- 
ple suggests that it is biased somewhat 
in favor of the middle and upper socio- 
economic classes. 


Procedure 


In each classroom the research as- 
sistant who administered all of the 
tests passed letterhead size paper to 
the subjects and asked them to draw, 
with pencils, a picture of a man. While 
the pupils drew, their teacher was 
asked to make a judgment of each 
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child’s overall intelligence and to place 
him in one of seven graduated cate- 
gories of intelligence. (The Indonesian 
term ketjerdasan was used to mean 
intelligence.) The investigators’ pur- 
pose was to learn whether there was a 
relation between scores on the Draw- 
A-Man Test and intelligence, accord- 
ing to the teacher’s own estimate of 
each pupil’s overall ability. The seven 
intelligence categories were named: 
very highest, quite high, somewhat 
above average, average, somewhat be- 
low average, quite low, and very low- 
est. The teachers were instructed to 
think of these levels as referring to 
school childen; so the lowest category 
was for the least intelligent children 
found in school, not the least intelli- 
gent in the general population. 


RESULTS 


Table 1 compares the Indonesian 
pupils with the normal-school-progress 
group from Goodenough’s original 


standardization sample. (Goodenough 


compared an advanced-progress group 
with normal-progress and retarded- 
progress groups but she based the test’s 
standards only on the normal-school- 
progress group.) 

Although the Indonesian data were 
at first separated for analysis into pri- 
vate and public school samples, the 
means and standard deviations for the 
private and public schools were found 
to be almost identical at each age 
level. Since it appeared that the two 
groups represented the same popula- 
tion, they were combined for compari- 
son with the American sample. 

As shown by Table 1, the Indonesian 
group’s mean was above the Goode- 
nough-normal-progress miean at ages 
5 (difference significant at .01 level) 
and 6 (significant at .05 level). But 
beyond age 6 the Indonesian means 
lagged behind the Goodenough-nor- 
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mal-progress means at all ages from 
7 through 12 (all significant at .01 
level) with the exception of age 11 
where the Indonesian group spurted 
ahead of the Goodenough group a 
slight but statistically insignificant 
amount. (At no age did the Indonesian 
average rise as high as the Goode- 
nough - advanced - school - progress 
group or fall as low as the Goode- 
nough - retarded - school - progress 
group.) 

Indonesian scores on the Draw-A- 
Man Test at each age level showed 
significantly more variation than did 
the Goodenough - normal - progress 
scores. These differences in variances 
were significant at the .01 level for 
ages 6, 7,8, 10, and 11. They were sig- 
nificant at the .05 level for ages 5, 9, 
and 12 (Table 1). Perhaps this is due 
to the fact that by definition the 
Goodenough-normal-progress group 
did not contain the extremes that 
would be found in an unstratified sam- 
pling of school children. 

In Table 2 correlations (r) between 
Draw-A-Man scores and teachers’ rat- 
ings of intelligence are reported for 
each grade level, kindergarten through 
sixth. The correlations were all posi- 
tive and moderately low or, as in 
Grades 2 and 4, quite low. 

Table 3 shows correlations (r) be- 
tween pupils’ Draw-A-Man Test 
scores and the most recent end-of-the- 
semester marks received by the pupils 
in various school subjects. (The Indo- 
nesian marking system uses numbers 
ranging from 1 to 10, with teachers 
also commonly adding marks halfway 
between each pair of numbers, such 
as 544. The extreme marks of 1, 2, 9, 
and 10 almost never appear.) 

All correlations were positive. They 
ranged from very low (.04) to rather 
high (.80). In general the highest cor- 
relations were between the Goode- 





R. MURRAY THOMAS AND ANWAR SJAH 


TABLE 1 ‘ 
CoMPARISONS OF INDONESIAN WITH AMERICAN GROUP 


Group 


Indonesian: 
N cases 
M 
Median 
SD 
Goodenough-nor 
mal-progress 
N cases 
Vv 
Median 
SD 


nough test and arithmetic marks. Next 
highest were those in physical science 
(not taught below Grade 5), geog- 
raphy, and biology. On the average, 


TABLE 2 
CORRELATIONS OF GOODENOUGH 
Scores WITH TEACHER RATINGS 
oF INTELLIGENCE 


Test 


Grade level 


210 | 238) 221 | 218) 151 | 97 


32°*) .07|.27°*| .11/.29**| 22° 


Age at last birthday 


correlations with reading, Indonesian 
language (the national language), and 
Sundanese (the local dialect) were 
somewhat lower. 


SUMMARY AND CONCLUSIONS 


In Bandung, Indonesia, the 1,245 
school children, kindergarten through 
Grade 6, who were given the Goode- 
nough Draw-A-Man Test did not, on 
the average, score as high as did the 
American group on which Goodenough 
originally based her standards for the 
test, suggesting that the American 
standards for mental ages should not 
be applied to Indonesians. 

When Goodenough test scores were 


TABLE 3 
CORRELATIONS OF Draw-a-MAN Scores anp SussecT MaTreR MARKS 


Subject matter 


Arithmetic 
Reading 
Indonesian 
Sundanese 
Geography 
Biological science 
Physical science 


6 
105 


so** 
20* 
32** 
O4 
64** 
55** 


.69** 
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correlated with school marks in var- 
ious subject matter areas, the median 
correlation was about .30. The highest 
relationships were found between the 
Draw-A-Man Test and arithmetic 
marks (from r = .42 tor = .80). Cor- 
relations between Draw-A-Man scores 
and teachers’ judgments of children’s 
intelligence were low, ranging from .07 
to .32 for different grades. 

The writers concluded that the 
Goodenough test yielded sufficiently 
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promising results to warrant its use as 
a measure of ability for Indonesian 
children (especially for estimating 


arithmetic and science abilities in up- 
per elementary grades) until a more 
adequate test has been developed. 
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AMERICAN GRADUATE STUDENTS: 


SOME CHARACTERISTICS OF ASPIRING TEACHERS 
AND RESEARCHERS 


DAVID GOTTLIEB 


De partmeé nt of Socio o”gy and 


In recent years, increasing attention 
has been paid to the phenomena of 
adult socialization as observed within 
American colleges and _ graduate 
schools (Becker & Strauss, 1956; 
Gottlieb, 1961; Jacob, 1957; Merton, 
Reader, & Kendall, 1957). While the 
ratio of speculation to empirical find- 
ings in this field is high, the available 
material would indicate that changes 
do occur in the values, attitudes, and 
behavior patterns of students in train- 
ing and that these changes may at 
least in part be attributed to the social 
system of our educational institutions. 
Several investigators (Becker & Geer, 
1958; Spaeth, 1959) have attempted 
to note how changes in the occupa- 
tional values expressed by graduate 
students may be tied in with a theory 
of “anticipatory socialization” (Mer- 
ton & Kitt, 1955), a process by which 
the individual adopts the values of a 
group to which he aspires but does not 
vet belong. 


Purpose 

The research being reported here 
deals with a comparison of two groups 
of American graduate students: (a) 
the student who comes into the grad- 
uate school system with a preference 
for a career in either teaching or aca- 
demic research and reports that there 
has been no change in his preference 
as he has moved through professional 
training, (b) the student who states 
that since he has been in graduate 
school either teaching or research has 
become more attractive post- 
graduate career choice. major 


a 


as 


The 


Anth rope logy 
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Michigan State University 


purpose of this study was to investi- 


gate how these students, who find 
themselves at different stages of social- 
ization and career commitment, vary 
in respect to certain values and atti- 
tudes 


METHOD 


National Opinion Research 
Center’s sample of graduate students from 
which the data for this analysis has been 
taken is a two-stage stratified cluster sam- 
ple of the enrollment of American graduat« 
schools which offered the PhD in the “tradi- 
tional arts and sciences” in the autumn of 
1958. A total of 2,842 students from 25 grad- 
uate schools participated in this survey.’ 

Procedure. In order to obtain some meas- 
of the source and direction of career 
change each student was asked the follow- 
ing 


Subjects. The 


ure 


Please rank the following in terms of 
your personal preference as a future occu- 
pation 
Teaching undergraduates 
Teaching graduates 
Doing research in your field __ 

d. Academic administration 

Have your opinions on these alterna- 
tives changed since you first decided to go 
to grad school? Please write the letter 


I 
or lett 


a 


b 


ite 
ers of alternatives which seem more 
de sirable to you now 

The responses to this set of questions were 
used as the basis for a change index. Persons 
who indicated that any alternative was more 
desirable to them are considered “changers” ; 
persons who indicate no change in preference 
considered “nonchangers.” It was found 
41% of the graduate students in this 


are 


that 


*The research reported here is part of a 
larger invéstigation of American graduate 
students conducted by the National Opinion 
Research I am indebted to James 
A. Davis, Director, and to Joe L 
Spaeth, Assistant Study Director, for their 


continued cooperation. 


Ce nter 
Study 
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TABLE 1 
CAREER PREFERENCES AND CHANGE STATUS* 


Changing to 


Present preferred career teaching 


College teaching 19 
Research field 10 
Other® Ss 


Changing to 
research 


a 


No change Total 


< 


100 
100 
100 


888 
936 
812 


19 62 
26 64 
17 75 


* At this point our discussion of changers is limited only to those who report a change toward research or teaching 


A third group of ambiguous changers include those who 
these in conjunction with administration, or some 
> The “other 


teaching, parish work, etc 


group includes students who wish 


sample do report a change 
their career preferences 


RESULTS AND DISCUSSION 


Table 1 shows which students in 
terms of present career preference 
have changed and the direction of that 
change. 

From Table 1 it can be seen that 
about a third of the students who plan 
a career in either teaching or research 
indicate that there has been a career 
interest change of some kind. Among 
the “others” there is less overall change 
—amounting to one out of every four 
subjects in that category. In respect to 
direction of change Table 1 shows: (a) 
those who state a current carreer pref- 
erence for teaching are evenly split— 
19% stating a stronger interest in 
teaching and 19% a stronger interest 
in research, (b) 10% of the researchers 
are now more favorably disposed to- 
wards teaching while 26% state they 
now find research more attractive as 
a postgraduate career, (c) in the 
“other” category change goes in the 
direction of research at a better than 
2 to 1 rate. The data suggest that 
the graduate school experience has the 
effect of bringing students closer to a 
research orientation, and that this 
move toward research is felt by stu- 
dents in each of the occupational 
groups. 


show a preference for both teaching and research, either of 
other alternatives in addition to those mentioned above 


to enter 46 professional practice, administration, secondary school 


Differences in Values and Attitudes 


Included in the graduate student 
questionnaire is a set of “dilemmas,” 
a group of imaginary situations in 
which the respondent is asked, after 
being confronted with two lines of ac- 
tion with alternate implications: 
“What would you do?” or “What 
would you prefer?” 

One dilemma has to do with the dis- 
tinction between “localism” vs. 
mopolitanism” in academic careers 
and consists of the following question 
“In the long run would you rather be 
known and respected (a) throughout 
the institutions where you work or (b) 
among specialists in your field in dif- 
ferent ?” Subjects who 


“Cos- 


institutions? 
checked a were classified as “locals”’ 
while those who checked b were con- 
sidered “cosmopolitans.” 
Table 2 shows that in each case 
TABLE 2 
CaREER PREFERENCE, CHANGE, 
**LocaL-CosMOPOLITAN” 


AND 


Cosmopolitan 


Present pre 


ferred career . 
Change 


in career 
preference 


No change 
in career 
preference 


552 53 362 
586 67 587 


Teaching 48 
Research* 77 

*x*—significant at <.001 level 
nonchangers 


research, changers, 
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TABLE 3 
CAREER PREFERENCE, CHANGE, 
WorkK ORIENTATION 


AND 


Percentage who would devote all or the 
bulk of their uncommitted time to work 


Present pre- . _ 


ferred career : 
Change 


in career 
preference 


No change 
in carreer 
preference 


371 
590 


Teaching* 69 
Research 69 


*x*—significant at <.001 level (teachers—changers 


and nonchangers 


those with the research orientation 
show the greatest desire for the na- 
tional recognition. The difference 
between the changers and the non- 
changers is found when the actual per- 
centage differences are compared. The 
difference is one of intensity and not 
direction. Assuming that one’s cosmo- 
politan orientation is tied to his career 
preferences, the results in Table 2 are 
what might be expected. Researchers 
who have not changed are most cosmo- 
politan as this is the type of profes- 
sional view that would go with an un- 
changing attachment to a research 
career. Teachers who have not changed 
are least cosmopolitan since their 
frame of reference and operation 
would most likely be the local aca- 
demic institution. 
Significant differences 
found when respondents in each of the 
four groups were compared in respect 
to the postgraduate use of free time. 
Table 3 shows that while almost two- 
thirds of the research changers are in- 
clined to devote the major part of 
their time to their work, only about 
half of the changers toward teaching 
are so inclined. A tentative interpreta- 
tion would be that changers to teach- 
ing consist of a number of students 
who see teaching as a way of life in 
which the individual is able to regulate 
his time since he is guided by the num- 


were also 


ber of hours a specific class meets. It 
may well be that these are graduate 
students who hold the more traditional 
(and perhaps naive) view of the aca- 
demic world—one in which the pro- 
fessor prepares his lectures, meets his 
classes, and then retires to the solitude 
of his study. The nonchanging teachers 
appear to be no different than the re- 
searchers in the use which they would 
make of their free or uncommitted 
time. Career preference and degree 
of career commitment are also found 
to be related to how respondents view 
the teaching and research activity. 
Table 4 shows that researchers are 
least likely to agree with the state- 
ment, “teaching is intrinsically more 
satisfying than research,” those who 
have changed to teaching, and those 
teachers who have not changed being 
most in agreement with the statement. 
Not unlike the “local-cosmopolitan” 
situation it would appear that the re- 
sponses of the changers to teaching 
and research is partially determined 
by the fact that these are students in 
transit. Included are: (a) students 
who have moved from teaching to re- 
search and now question the validity 
of the statement; (b) students who 
entered the graduate system with a 
preference for teaching and who have 
withstood to some extent the research 
influences of the graduate school, and 


TABLE 4 
CAREER PREFERENCE, CHANGE, 
TEACHING VERSUS RESEARCH 


AND 


Percentage agreeing that teaching is 
intrinsically more satisfying than 
research 

Present career 

preference 

Change 

in career 
preference 


No change 
in career 
pre ference 


363 
570 


Teaching 64 543 56 
7 


Research* 580 26 


*x*—significant at « level (researchers—changers 


and nonchangers 
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in a sense have rededicated themselves 
to teaching; (c) those students who 
have made the shift from research to 
teaching. On the other hand, the non- 
changers present a different picture. 
Here are people who have retained 
that which they brought with them 
into the system in respect to teaching 
and research. The nonchanging re- 
searchers are strongest in their con- 
victions that in fact research is more 
satisfying than teaching. The teachers 
who have not changed are most willing 
to accept the idea that teaching does 
hold an intrinsic satisfaction over re- 
search. 

Responses to yet another “dilemma” 
situation provide further evidence to 
support the proposition that there are 
significant differences in attitudes and 
values when comparisons are made be- 
tween teaching and research oriented 
students. In this case re spondents were 
asked the following: 


You are a full professor in a small but 
good department. Two men are being 
considered for a tenure position, but only 


y 


one can be appointed 

Smith is very well liked by tl! 
faculty, and throughout the institution 
He is an effective teacher and is extremely 
well read, both in his field and in other 


€ stude nts, 


areas 

It is quite 
never going to produce 
of scholarship which will make a 
mental contribution in the field 

Jones is known to everyone as a prima 
donna He to get 
and students complain about 
in teaching. It 
in the long run he 
to be one of the major intelle 
in the field. 

Which man would 
the department 


9 
tions 


cle ar, howe ver, th 
h or work 


funda- 


reseal 


along with, 
his lack of 
clear, how- 


is difficult 
interest Is quite 
is destined 


tual figures 


ever, that 


vou vote for 


ymmenda- 


when 


makes its re 


Each group, it would appear, is most 
eager to give support to his own kind 
The teachers, be they changers or non- 
changers, are most enthusiastic about 
Smith. The 


1 
researchers 


¢ specially 


TABLE 5 
CAREER PREFERENCE, CHANGE, 
TeNnuRE DILEMMA 


AND 


Percentage who would 

Present career 
preference Change 
in career 

preference 


No change 
in career 
pre ference 


Teaching SS 552 85 


tesearch 593 71 


those who report no change, are least 
interested in bringing Smith into the 
department. While Table 5 does sup- 
port a general hypothesis of differ- 
ences among teachers and researchers, 
it presents data of additional interest. 
While each group indicates a prefer- 
ence for a colleague who is most like 
themselves, it will be noted that in 
each cell the majority express a pref- 
erence for Smith—the teacher. It is 
possible to only speculate why this is 
so. Perhaps individuals prefer Smith 
seems most congenial and 
easiest to get along with. On the other 
hand it may well be that researchers 
and teachers are expressing a need for 
something they find lacking in their 
own graduate experience, namely a 
faculty member who would give more 
of his time to his students and less to 
his research interests. 


since he 


SUMMARY 


The results of a national survey of 
2.842 graduate students would indicat 
that graduate students do alter their 
career preferences as they progress 
through their professional training 
Significant differences are found in at- 
titudes and values when these stu- 
dents are compared in respect to ca- 
reer preference and degree of career 
commitment. 

The data presented would suggest 
that a form of “anticipatory socializa- 
tion” is in operation and has the effect 
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of preparing students for their post- 


graduate careers. 
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THE ACQUISITION AND RETENTION OF PAIRED 
ASSOCIATES BY GOOD, AVERAGE, AND 
POOR READERS’ 

WAYNE OTTO 
University of Oregon 


The present study investigates the 
relative abilities of good, average, and 
poor readers to learn and to recall a 
list of paired associates. The particu- 
lar variables selected for study in this 
connection were chosen primarily be- 
cause of questions raised by an earlier, 
exploratory study. 

The exploratory study employed a 
learning task similar to the one used 
in the present study: a list of five 
paired associates, each pair consisting 
of a common geometric form and a low 
association value trigram. The task 
discriminated between good and poor 
readers sufficiently well to suggest 


further experimentation in examining 
several specific questions raised by the 


study. 

1. In the earlier study, the subjects’ 
IQ scores varied considerably. With 
intelligence level differences mini- 
mized, would the demonstrated differ- 
ences between good and poor readers’ 
ability to master paired associates per- 
sist? 

2. The exploratory study had em- 
ployed good readers and extremely 
disabled readers. Would the differ- 
ences persist if the poor reading group 
consisted of subjects reading in the 
lower quarter of their class? How 
would a group of “average” readers 
perform? 

3. There appeared to be a tendency 
for visual-auditory reinforcement to 

‘The study is based upon data collected 
for a doctoral thesis at the University of 
Wisconsin. The writer is grateful for help- 
ful comments to his thesis committee: Theo- 
dore L. Harris, Chester W. Harris, and 
Virgil E. Herrick 


result in more rapid learning than did 
purely auditory reinforcement. With 
more adequate controls, would a par- 
ticular mode of reinforcement con- 
tinue to be more effective than 
another? Or, with provision made for 
the study of a possible interaction be- 
tween mode of reinforcement and 
reading level, might one mode of re- 
inforcement prove to be better for poor 
readers while another would be better 
for good readers? 

4. If grade placement of subjects 
were to be varied systematically would 
this grade placement variable interact 
significantly with reading level and/or 
mode of reinforcement? For example, 
might not the most effective mode of 
reinforcement vary from grade level 
to grade level? 

5. What is the effect of these vari- 
ables—reading level, grade placement- 
chronological age, and mode of rein- 
foreement—upon total trials required 
to relearn the list after 24 hours? The 
results of the earlier study suggest that 
there would be no difference in num- 
ber of relearning trials required by 
good and poor readers. 

Studies have been reported that 
have been concerned with one or more 
of the above questions. Five general 
statements regarding these studies 
can be made here. 

1. Level of intelligence appears to 
be a significant variable in associative 
learning. There appears to be an in- 
verse relationship between IQ and 
trials required to master a list of 
paired associates (Gates, 1930) 


2. Studies show that associative 
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learning ability and reading ability 
are directly related, but there is little 
agreement as to why or to what ex- 
tent this is so (Fildes, 1921; Gates, 
1935; Hincks, 1926; Monroe, 1932; 
Raymond, 1955; Vernon, 1958). 

3. In general, studies have failed to 
demonstrate a clear advantage for any 
one type of reinforcement. The usual 
types of reinforcement investigated 
have been auditory, visual, and tac- 
tile/kinesthetic, presented singly and 
in combination (Berman, 1939; Burt 
& Lewis, 1946; Kirk, 1933; Raymond, 
1955; Rivkind, 1958; Stauffer, 1948; 
Williams, 1952). 

4. Studies have not shown adequate 
control of the learning tasks employed 
to permit conclusive interpretations of 
results. The failure of many studies to 
demonstrate advantages of any par- 
ticular mode of reinforcement may 
simply reflect shortcomings of the task 
employed rather than absence of ef- 
fects of the task variables. 

5. There has been no real concern 
with what might be important inter- 
actions. Studies have generally been 
concerned with but one level of read- 
ing ability, with a particular mode of 
reinforcement, with a general range of 
chronological ages or levels of ability 
at the possible cost of what might have 
been significant interactions between 
two or more of these variables. 

The present study, then, attempts to 
control and study what appear to be 
pertinent variables and make allow- 
ance for consideration of possible sig- 
nificant interactions between selected 
variables. The study is an experi- 
mental investigation of relationships 
that, once demonstrated, can serve as 
bases for further research in learning 
to read situations. 

Three hypotheses provide a focus 
for analysis of the data and subse- 
quent discussion. 

1. Good readers, 


average readers, 
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readers will differ in the 
number of trials required to learn a 
list of paired associates. 

2. Mode of reinforcement will inter- 
act significantly with reading level 
and/or grade level. 

3. Good, average, and poor readers 
will not differ in number of trials re- 
quired to relearn a list of paired asso- 
ciates 24 hours after acquisition trials. 


and poor 


METHOD 


Three major variables were studied: read- 
ing level, grade placement-chronological age, 
and mode of reinforcement. 


Subjects 


One hundred and eight subjects (four 
replications of the 3 X 3 X 3 design), chosen 
from a total population of about 2,900 ele- 
school children from three schools 
served in the experiment. All subjects met 
the following criteria: 

Intelligence. A group test IQ score be- 
tween 95 and 110. Scores were from the Otis 
Quick Scoring at Grade 2, and from forms 
of the California at Grades 4 and 6. The 
attempt was to hold intellectual capacity 
within the average range by eliminating 
high and low deviant scores. The “average” 
score was subject to corroboration by the 
classroom teacher. 

Reading level. Reading test scores falling 
in one of three specified categories denoted 
good, average, or poor. Scores were from 
forms of the Metropolitan Achievement 
Tests. Raw test scores were converted into 
stanine equivalents, which divide the dis- 
tribution into nine subdivisions of approxi- 
mately the same range. Thus, operationally 
defined, good readers were those whose test 
scores fell in the seventh, eighth, or ninth 
stanines; average readers had scores falling 
in the fifth stanine; and poor readers had 
scores falling in the first, second, or third 
stanine. The fourth and sixth stanines were 
dropped avoid overlap between 
groups. The level to which a subject was 
assigned was subject to corroboration by 
the classroom teacher 

Grade level. Placement at s d, fourth, 
or sixth grade. Subjects were sen from 
three grade levels in order to study the pos- 
sible effect of educational development- 
chronological age upon efficiency in _ the 
] Chronological age range was 


,onths to eliminate any wid 


mentary 


out to 


earning ta k 


limited to 121 
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deviations from the usual age at grade level 

A pool of childen who met the criteria was 
selected and four subjects were then assigned 
to each experimental condition. Since the 
possible effect of sex differences upon learn- 
ing efficiency under any of the experimental 
conditions was not known, two boys and 
two girls were assigned to each experimental 
condition. Because no systematic differences 
were demonstrated on the basis of sex, this 
will not be further discussed 


Task 
List. The 


in the study evolved from the preliminary 
study done by the writer. Each pair consists 
of a common geometric form and a low as- 
sociation value CVC from the 
Archer (1960) list 

The specific geometric forms were chosen 
because preliminary investigation showed 
that most elementary school children had a 
dominant name for each one (diamond, cir- 
cle, triangle, star, square). Geometric form- 
trigram pairs appeared to be preferable to 
trigram-trigram pairs to avoid needlessly 
confusing the younger subjects and subjects 
with poor reading ability with two word-like 
stimuli in each pair 

The trigrams chosen had association val- 
ues of 25% or less according to the Archer 
list. The five trigrams were chosen to em- 
ploy the short sounds of the common 
without repeating any 


paired-associates list employed 


trigram 


vowels—a, é, t, 0, U- 
consonant in the list 

The actual list follows. (The common 
name of the form is given here in lieu of the 
form itself.) Diamond-fep, circle-miv, tri- 
angle-wuc, star-yad, square-gox. In those 
reinforcement conditions in which the sub- 
ject received visual presentation of the tri- 
grams, the trigrams were printed in lower 
case manuscript style 

Since it was felt that some basis for com- 
parison of associations evoked by the indi- 
vidual forms and trigrams in the different 
groups of subjects would have value in in- 
terpreting the data, an association test was 
implemented in the study. This test and re- 
sults will be alluded to, but space does not 
permit further elaboration here 

Apparatus. A Stone memory drum was 
employed in controlling presentation of 
forms. The original box encasing the re- 
volving cylinder provided an opening 5” X 
5” for presentation of stimuli. A slide open- 
ing was devised to permit the experimenter 
to expose 1” X 5” portions of the total 
opening. The stimulus sheet mounted on 
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the cylinder was so arranged that five dif- 
ferent orders of presentation were possible 
The forms presented on the memory drum 
were ¥%” high. 

Acquisition. All testing was done in a 
room with only the experimenter and the 
subject present and with a minimum of dis- 
tracting outside noise. The writer served as 
experimenter throughout the experiment 

Each form was presented for 4 seconds 
at which point the subject was expected to 
say the form name—followed by a 4-second 
presentation of the form-trigram, followed 
by a 4-second rest. There was a 16-second 
intertrial rest. Pairs were first presented in 
serial order until the subject reached the 
criterion of one correct anticipation of form 
names for the entire list. Pairs were then 
presented in scrambled order to the same 
criterion. The total score was serial plus 
scrambled trials to criterion. This sequence 
of presentation was employed because im- 
mediate scrambled presentation proved to 
be disconcerting to the younger subjects 
The scrambled presentation countered any 
sequential learning effect 

Recall/relearning. Subjects were asked to 
relearn the list after 24 hours. Pairs were 
presented in scrambled order in the same 
manner as in acquisition trials. The subjects 
continued to the criterion of one correct 
anticipation of form names for the entire 
list 


Reinforcement 


The term “mode of reinforcement” is 
used in the present paper to refer to the 
manner in which the correct form-trigram 
pairs were presented to the subjects. “Con- 
firmation” might be an equally apt term 
The actual procedure is described in the 
following paragraphs. The point to be made 
here is that the word “reinforcement” does 
not conform to the strictly conventional us- 
age. 

Three modes of reinforcement were em- 
ployed. In practice the reinforcement was 
cumulative: auditory, visual-auditory, and 
kinesthetic-visual-auditory. For the sake of 
simplicity, however, the three modes of re- 
inforcement will be denoted auditory, visual, 
and kinesthetic, respectively 

Auditory. The form was presented for 4 
seconds, followed by a second 4-second pres- 
entation of the form accompanied by the 
experimenter’s articulation of the appropri- 
ate trigram (form name) 

Visual. The form was presented for 4 
seconds, followed by a second 4-second pres- 
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TABLE 1 
MEAN ACQUISITION TRIALS 


Reading level 


Good 


11.42 9.14 8.67 


entation of the form accompanied by the 
experimenter’s articulation of the appropri- 
ate trigram plus visual presentation of the 
trigram. For the visual presentation, the ex- 
perimenter held a card bearing the printed 
trigram contiguous to, and to the right of, 
the form presented by the memory drum 
Cards, 1” X 2”, with 4%” xX Y%” centered 
letters, approximately the size of the forms, 
printed in black were employed 

Kinesthetic. The form was presented for 
4 seconds, followed by a second 4-second pres- 
entation of the form accompanied by the ex- 
perimenter’s articulation of the appropriate 
trigram plus a visual-kinesthetic presen- 
tation of the trigram. For the visual-kines- 
thetic presentation, the was pre- 
sented a card bearing the form-trigram pair 
and asked to trace the trigram with his 
finger. Cards, 10” X 4”, with 14” X 2” let- 
ters, a size which the subject could readily 
trace, printed in black were employed. Let- 
ters were lower case manuscript, of the type 
most familiar especially to the second grade 
subjects 

Pretraining. Each subject was presented 
a card bearing a sample pair of stimuli 
(heart-keb) before acquisition trials began. 
The subject gave his name for the heart- 
shaped figure and was told that he would be 
asked to learn a new name. The test forms 
were then presented and paired with the 
appropriate trigrams in the manner of the 
reinforcement to be given. Subjects to re- 
ceive kinesthetic reinforcement practiced 
tracing the sample trigram quickly 


subject 


RESULTS AND DISCUSSION 

A comparison of mean IQ scores 
shows no significant differences be- 
tween groups compared in subsequent 
analyses. It appears that the random 
assignment of the pooled subjects to 
experimental conditions was reason- 
ably successful in eliminating between 
group IQ differences; therefore, be- 
tween group differences do not appear 


Average 


13.03 


Reinforcement 


Poor Auditory Visual Kinesthetic 


j£ 
19.23 


13.36 12.33 11.28 


to be attributable to IQ differences be- 
tween groups 

Acquisition. Mean acquisition scores 
for the different groups for each of the 
three main variables are shown in 
Table 1. An analysis of variance (Ed- 
wards, 1950) of the total acquisition 
scores is presented in Table 2. There 
was little evidence of heterogeneity 
of variance (chi square = 30.72 for 
26 df, p > .20). Each of the three main 
effects is significant at the .01 level. 
That differences in performance by 
grade level are dependent upon read- 
ing level of subjects is indicated by the 
significant grade X reading level in- 
teraction. That differences due to mode 
of reinforcement are dependent upon 
grade placement of subjects is indi- 
cated by the grade X reinforcement in- 
teraction. There is no significant read- 
ing level X reinforcement interaction, 
nor is there a significant triple inter- 
action. 

Table 3 presents results of Tukey 
gap tests (Tukey, 1949), which were 


TABLE 2 
ANALYSIS OF VARIANCE OF THE 
ACQUISITION TRIALS 


Source df MS F 


Grade (G) 498.94 |79.91** 
Reading Level (L) 406 .735'65.14** 
Reinforcement (R) , 39.065) 6.25** 
GX L 34.347) 5.50** 
GXR 975) 4.96** 
LXR 5.16 
GxLxR 562) 1.85 
Within 244 
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TABLE 3 


Resvu.ts or Tuxey Test or SIGNiricant Gaps 


Grade 


Gap Level 


P 15.28 
5.00** 
13.03 


a 


8.67 


m6 < 
*** The auditory/kinesthetic between 
run to determine where significant dif- 
ferences between group means existed 
within the three main effects. Signifi- 
cant differences in mean acquisition 
trials were demonstrated between each 
of the three grade levels and between 
each of the three reading levels. The 
differences between the mode of rein- 
forcement mean acquisition trials are 
approaching the .05 level of signifi- 
cance for each mode of reinforcement, 
but only the difference between the 
auditory and visual mode of reinforce- 
ment meets the <.05 requirement. 
Further interpretation must, of course, 
consider the significant interactions 
that have been demonstrated. 

Several of the questions and hy- 
potheses can be examined in view of 
the acquisition data. 

Hypothesis 1: Good, average, and 
poor readers will differ in the number 
of trials required to learn a list of 
paired associates. 


TABLE 4 


Mean AcqQuisiTIOon TRIALS: 
Grave X Reapine LEVEL 


Reading level 


Good Average 


18.17 
11.83 
9.08 


10.58 


8.33 
7.08 


Reading level! 


Mean trials 


neans gap is signifcant (p < 


Reinforcement 


Mode Mean trials 


13 .36 
12.33 


9Qeee 
28 


1] 


01 


The hypothesis is accepted, with 
the restriction that the grade level of 
subjects tested will tend to influence 
the magnitude of differences demon- 
strated. Table 4 makes clear the ex- 
tent of the influence of grade level 
upon differences between reading 
levels. Examination of the mean ac- 
quisition trials presented shows that 
poor readers in Grade 2 took almost 
twice as many trials to master the list 
did good readers; whereas poor 
readers in Grade 6 took only 1.6 times 
as many trials as did good readers 
Also, good readers at the three grad 
levels perform more nearly alike than 
do the poor readers. It is suggested 
that the task is not sufficiently difficult 
at the higher grade levels to preserve 
the marked dichotomy displayed at 
Grade 2. 

Hypothesis 2: Mode of reinforce- 
ment will interact significantly with 
reading level and/or grade level. 

The hypothesis is accepted: there 
is a significant grade < reinforcement 
interaction. Mode of reinforcement 
does not, however, interact with read- 
ing level, contrary to what seems to be 
a basic assumption when added cues 
are stressed in much remedial work. 

The nature of the grade X reinforce- 
ment interaction is made clear by 
Table 5. It can be seen that the most 


“as 





WAYNE OTTO 


TABLE 5 
MEAN AcQuisiITION TRIALS: 
GRADE X REINFORCEMENT 





Reinforcement 
Grade ——————_- — 


Auditory 


Visual Kinesthetic 





14.50 
10.83 


18.42 
9.83 
8.75 


16.33 
13.58 
10.17 





efficient mode of reinforcement (re- 
quiring the fewest trials) varies by 
grade level. With the second grade 
subjects, kinesthetic reinforcement ap- 
pears to make for the fewest trials; 
whereas, visual reinforcement appears 
to be most efficient for the fourth grade 
subjects and kinesthetic and visual are 
almost equally effective for the sixth 
grade subjects. The implication seems 
to be that the function of different cues 
supplied by the several modes of rein- 
forcement changes as subjects progress 
in grade level and chronological age. 
This may help to explain why gross 
studies often fail to show a particular 
mode of reinforcement to be better 
than others. In order to secure positive 
results in any predictable manner, one 
would need to control grade level- 
chronological age. 

The answers to two of the questions 
raised by the earlier study are clear 
from the consideration of Hypothesis 
1 and Hypothesis 2: (a) When intel- 
ligence is held within a stated range, 
will good, average, and poor readers 
differ in the number of trials required 
to learn a list of paired associates? 


(6) Will there be significant interac- 
tions between reading level, mode of 
reinforcement, and grade level? The 
answers to both questions are affirma- 
tive, subject to the restrictions pointed 
out in connection with the hypotheses. 

The answers to two other questions 
are also affirmative: (a) Will the tra- 
ditional modes of reinforcement sig- 
nificantly influence rate of learning? 
It has been shown that the particular 
mode of reinforcement that is most ef- 
fective will vary from grade to grade. 
(6) Is grade level-chronological age 
a significant variable in determining 
the number of trials required to master 
a list of paired associates? The affirm- 
ative answer is restricted by the fact 
that differences in number of trials re- 
quired at different grade levels will be 
influenced by the reading proficiency 
of the subjects and by the mode of re- 
inforcement employed. 

Recall and relearning. “Recall 
score” is the number of form names 
correctly anticipated 24 hours after 
the acquisition trials. “Relearning 
score” is the total number of trials re- 
quired to enable the subject to cor- 
rectly anticipate form names for the 
entire list presented in scrambled or- 
der. 

Mean recall and relearning scores 
for the several groups by variable are 
presented in Table 6. It can be seen 
that in general the mean recall scores 
vary in the same manner as the mean 
relearning scores. For this reason and 
because relearning efficiency probably 


TABLE 6 


MEAN RECALL AND RELEARNING ScoRES 


Grade 


Recall 
Relearning 


Reading level Reinforcement 


Vv 
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most adequately reflects retention, 
only the relearning scores were sub- 
jected to analysis of variance. This 
analysis is presented in Table 7. Only 
grade level was found to be significant. 
Table 6 shows that the mean relearn- 
ing scores for Grades 4 and 6 are iden- 
tical. Consequently, it can be con- 
cluded that the only significant 
differences in relearning scores are at- 
tributable to the fact that second 
grade subjects took more trials to re- 
learn than did fourth and sixth grade 
subjects. 

Hypothesis 3 and the related ques- 
tion can be examined in view of the 
relearning data. 

Hypothesis 3: Good, average, and 
poor readers will not differ in the num- 
ber of trials required to relearn a list 
of paired associates 24 hours after ac- 
quisition trials. And the question: 
What is the effect of the variables— 
reading level, grade placement, and 
mode of reinforcement—upon total 
trials required to relearn the list after 
24 hours? 

The hypothesis is accepted: there is 
no difference in relearning perform- 
ance due to reading level of the sub- 
jects. The answer to the question is 
that grade placement of the subjects 
alone significantly effects relearning 
after 24 hours. 

That there were no differences be- 
tween good, average, and poor readers 
in trials required to relearn the list 
seems to be a significant finding. This 
suggests that given sufficient reinforce- 
ment the future performance of good, 
average, and poor readers would tend 
to be similar. Thus, while subjects 
might require different numbers of 
trials to master a task, they might be 
expected to attain about the same per- 
formance level. This is, of course, part 
of the rationale proposed by some for 
the use of “teaching machines” or 
“autoinstructional devices.” 


TABLE 7 


ANALYSIS OF VARIANCE OF 
RELEARNING TRIALS 


Source df MS FP 





.70 | 5.69** 
.57 | 2.42 
49 


Grade (G) 
Level (L) 
Reinforcement (R) 

GXL 

GxXR 

LXR 

GxXLxXR 

Within 


~ b> 


13 | 
24 


a ee 


oo 





"pn < Ol 


Association test. The association 
test results indicated that the poor 
readers gave more associations to the 
individual stimuli of the paired-associ- 
ates list than did the good readers. As 
pointed out, space limitations preclude 
discussion of the association test; but 
the implication appears to be that 
there is no clear-cut relationship be- 
tween the number of associations 
evoked (fluency) and efficiency in the 
present learning task. 


SUMMARY AND CONCLUSIONS 


A 3 3 X 3 factorial design was 
employed to study the effects of three 
levels of reading proficiency, three 
levels of grade placement (chrono- 
logical age), and three modes of rein- 
forcement upon acquisition of a list 
of paired associates. One hundred and 
eight childen whose IQ scores were in 
the average, 95-110, range provided 
data for the investigation. 

The results warrant the following 
conclusions: 

1. Good, average, and poor readers— 
in that order—require increasingly 
more trials to master a list of paired 
associates. 

2. Sixth, fourth, and second grad- 
ers—in that order—require an increas- 
ing number of trials to master a list of 
paired associates ; but these differences 
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are significantly influenced by both 
the reading proficiency of the subjects 
involved and the mode of reinforce- 
ment employed. 

3. Mode of reinforcement as a vari- 
able interacts significantly with grade 
level. Therefore, studies purporting 
to investigate the relative efficiency of 
different modes of reinforcement must 
recognize grade level of the subjects 
as an effective variable. 

4. There is not a significant inter- 
action between mode of reinforcement 
and reading level. This is contrary to 
the assumption in instructional prac- 
tice that additional cues will be of 
value in a remedial teaching/learning 
situation. 

5. Analysis of total relearning scores 
showed grade level to be the only sig- 
nificant variable. Thus, it appears that 
once they have mastered a list of 
paired associates, poor readers will re- 
tain the associations as well as good 
readers. 

6. Analysis of the results of the as- 
sociation test indicates that the differ- 
ences in ability to learn a list of paired 
associates demonstrated by good, aver- 


age, and poor readers cannot be ex- 
plained simply in terms of number of 
meanings or associations attached to 
the stimuli. 


Two limitations seem obvious in 
considering the significance of the 
present study for the teaching/learn- 
ing of reading: (a) The universality 
of the present results needs to be dem- 
onstrated. (b)' The functional rela- 
tionship of the present task to learn- 
ing to read is not known. It is felt, 
however, that the present results can 
be of value in formulating hypotheses 
to be evaluated when reading tasks 
are employed in the experimental 
setup. 
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THE CONTRIBUTION OF RESPONSE 
IN MENTAL MEASUREMENT 


WILLAVENE WOLF 
Ohio State University 


Around the turn of the century, psy- 
chologists were active in investigating 
the relationship between speed of re- 
sponse and criteria of intelligence, as 
seen, for example, in the work of Gil- 
bert (1894) and Wissler (1901). Most 
of the early workers dealt with simple 
motor responses, as in reaction time 
studies, or at best with simple re- 
sponses. There appears to be little 
support for the existence of a general 
speed of response factor, as Tinker 
(1931) has pointed out. Generally 


negligible relationships have been ob- 
tained between speed of response on 
simple tasks and measures of intelli- 
gence. When significant relationships 
have been obtained, they have gen- 
erally been interpreted as a function 


of the character of the specific task 
employed. 

Thus it appears that rate of re- 
sponse on a speed test—one on which 
rate of response is the main determi- 
nant of the score—is essentially un- 
related to performance on measures of 
intelligence. It does not necessarily 
follow, however, that rate of response 
on a power test is unrelated to criteria 
of intelligence. A subject who success- 
fully completes difficult intellectual 
tasks quickly may have more mental 
ability than one who completes them, 
but must do so slowly. In such situa- 
tions, it is reasonable to suppose that 
power makes for speed, as Kuhlmann 
(1939) and Tinker (1931) argued. 

In addition to a concern about this 
general problem, the writers were in- 
terested in two intelligence tests: Ra- 
ven’s Progressive Matrices (revised 
order, 1956) and the Leiter Interna- 
tional Performance Scale—both non- 
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AND 
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State University of Iowa 


verbal tests. Specifically, we were 
interested in investigating the rela- 
tionships between rate of response to 
the individual items on these two tests 
and the total score (i.e., number right 
on the two tests, respectively), and 
certain independent measures. Some 
recent work with Progressive Matri- 
ces yielded rather low correlations be- 
tween total scores and achievement 
measures, around .40 (Knief & Stroud, 
1959). The form of the test and the 
method of administration make this 
an ideal test for use with the deaf and 
others handicapped in the use of a 
language. Obviously any improvement 
in its predictive power would be to the 
good. Some items from the Leiter were 
selected and used simply to further 
the interest in the general problem— 
the contribution of rate scores on a 
power test. 


PROCEDURE 


The subjects in this investigation 
were 102 fifth grade pupils in two 
small midwestern communities, repre- 
senting the entire fifth grade enroll- 
ment in the two communities. To these 
pupils were administered the Progres- 
sive Matrices, one-half of the tests in 
the Leiter scale, the Iowa Tests of 
Basic Skills, and the Lorge-Thorndike 
Intelligence test, Verbal Battery, 
Level 3. The Leiter tests used, starting 
with Year VI, were as follows: VI, 2 
and 3; VII, 2 and 4; VIII, 2 and 4; 
IX, 3 and 4; X, 2 and 3; XI, 1 and 4; 
XII, 2 and 4; XIII, 1 and 4; XIV, 1 
and 3; XV, 1 and 4; XVI, 3 and 4; 
XVII, 2 and 3. Progressive Matrices 
and the Leiter scale were administered 
individually. The examiner timed the 
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response to each item by means 2f a 
stop watch. The only alteration made 
in the directions was the addition of 
the sentence, “Do the items as quickly 
as you can, trying to get all the an- 
swers right.”’ 

The mean Lorge-Thorndike IQ of 
the sample was 109. The SD was 14. 
The mean PM raw score was 27.85. 
The SD was 8.19. The distribution was 
approximately normal. 

In addition to the number right 
score on Progressive Matrices and the 
mental age score on the Leiter scale, a 
time score, based upon the average 
time required to compile the items 
done correctly, was computed for each 
pupil. The MA value of each item used 
on the Leiter scale was doubled, in- 
asmuch as only one-half of the items 
was used. Progressive Matrices is 
made up of items of ascending diffi- 
culty. Thus it seemed probable that 
the time scores on some parts of the 
scale might be more significant than 
those on other parts. The scale was 
divided into fourths, numerically, and 
average time scores were computed for 
each pupil on each fourth of the scale, 
making it possible to determine the 
relation between speed of response and 
the criterion measures for each fourth 
of the scale. 

Time allowances on the Iowa Tests 
of Basic Skills are rather liberal, but 
the test does impose time limits. The 
number of subjects finishing each sub- 
test was ascertained. When fewer than 
90% of the subjects had finished a 
subtest, questions at the end were 
eliminated—back to a point reached 
by 90%. 


RESULTS 


As a first step in the analyses of the 


data, zero order correlations were 
computed (a) between average time 
score on the PM and Leiter tests and 
ITBS and Lorge-Thorndike scores and 
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(b) between number right scores on 
the PM and Leiter (MAs) and ITBS 
and Lorge-Thorndike scores. The re- 
sults are reported in Table 1. The cor- 
relations between Progressive Matri- 
ces and the Leiter scale on the one 
hand and ITBS and the Lorge-Thorn- 
dike test, on the other, are surpris- 
ingly low. Since in this investigation 
the two tests were not administered in 
the standard way, the coefficients re- 
ported in Table 1 should not be taken 
as representative of the predictive 
power of the tests. 

In order to determine the effective- 
ness of combining the average time 
scores with the number right scores on 
the PM and Leiter tests in the pre- 
diction of the composite achievement 
scores and verbal intelligence test 
scores, multiple correlation procedures 
were utilized. Table 1 gives the mul- 
tiple correlation coefficients for the 
variables involved. The composite 
ITBS scores and the Lorge-Thorndike 
test scores are regarded as the de- 
pendent variables, and average time 
scores and number right scores on the 
PM and Leiter as the independent 
variables. Beta weights were computed 
and tested for significance. They are 
also reported in Table 1. Combining, 
in multiple correlation, time and num- 
ber right scores on the PM and Leiter 
tests increased these tests’ prediction 
on achievement and verbal intelligence 
scores to about the same degree. All 
beta weights, except that involving the 
Leiter time and the Lorge-Thorndike 
scores, were significant at the .01 level. 
Thus, the addition of time scores to 
PM and Leiter number right scores 
may be considered to have increased 
significantly the correlations between 
these two tests and the ITBS and 
Lorge-Thorndike scores. 

The multiple correlation analysis 
indicated that making time a part of 


the scores increased the predictive 





SPEED OF RESPONSE IN MENTAL MEASUREMENT 


value of both the PM and Leiter tests. 
While the Leiter test did not lend it- 
self to further analysis, since the sub- 
tests attempted by the respective sub- 
jects varied, further analysis was 
undertaken on the Progressive Matri- 
ces. To determine whether or not time 
on any fourth of the PM was more 
important for predictive purposes than 
was time on any other fourth, the PM 
was divided into sets of 14 or 15 items 
and the average time scores on each 
set were correlated with the ITBS and 
Lorge-Thorndike scores. The fourths 
represent roughly four different levels 
of difficulty. Only 74 subjects earned 
scores on each of the four sets of items. 
Thus this analysis was based on 74 
eases. Table 2 presents the zero order 
correlations obtained between the av- 
erage time scores on each set of items 
and the ITBS and Lorge-Thorndike 
scores. The only significant correla- 
tion was that between average time 
for the third set of items on the PM 
and the Lorge-Thorndike test. 
Multiple correlations were com- 
puted to determine whether or not 
time scores on any fourth of the items 
on the PM when combined with the 
total number right scores yielded 
higher Rs than those of any other 


TABLE 1 
CoRRELATIONS BETWEEN THE RAVEN AND 
Lei1rer Tests anp ITBS anv Lorae- 
THORNDIKE Test AND BETA 
WEIGHTS 


Variable ITBS f L-T 


Raven Time | —.17 —.35°* | —.178 

Raven a8°* 254°° 
Right 

Multiple s80°* 420°* 

Leiter Time 060 36°° o78 —.043 

Leiter MA 56°* 357°° .680°* 

Multiple .460°* 


—.37°* 


43°° 


291° 
.310°° 


Note.—Raven Time vs. Raven Right, r = —.465; 
Leiter Time vs. Leiter Right, r = —.750 

* Significant at .05 level 

** Significant at .01 level 
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TABLE 2 
Zero ORDER CORRELATIONS BETWEEN Av- 
ERAGE Time Scores ror Eacu Fourts 
OF THE PROGRESSIVE MATRICES AND 
ITBS, Lorce-THORNDIKE, AND 
Totat Numper Ricst 
on PM 


Lorge- 
Thorndike 


— .22 


Average time 


All correct items on the 
first fourth of Progres- 
sive Matrices 

All correct items on the 
second fourth of Pro 
gressive Matrices 

All correct items on the 
third fourth of Pro- 
gressive Matrices 

All correct items on the 
last fourth of Progres- 
sive Matrices 
Note.—Raven Time on first 14 items vs. Raven 

Right, r = .157; Raven Time on second 15 items vs 

Raven Right, r = .230; Raven Time on third 15 items 

vs. Raven Right, r =~ —.458°*; Raven Time on fourth 

15 items vs. Raven Right, r = —.298* 

* Significant at .05 level 
** Significant at .01 level 


fourth. The results are reported in 
Table 3. Beta weights were computed 
and tested for significance. They are 
also reported in Table 3. 

The Rs involving the time scores of 
the third fourth of items are higher 
than those involving any other fourth. 
One might have predicted that the 
magnitude of the Rs would have in- 
creased with the difficulty of the 
items; i.e., that those of each succeed- 
ing fourth of the items would have 
been greater than those of the pre- 
ceeding fourth. Indeed a tendency in 
this direction was evidenced for the 
first three fourths. It seemed likely 
that the items comprising the last 
fourth of the test would, for these fifth 
grade pupils, be quite difficult and 
that, therefore, the average time 
scores of the various pupils would be 
based upon relatively few correctly 
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TABLE 3 


MuLtTiIPLe CorRELATIONS INVOLVING Eacu 
Fourts or PM Items 


R 8 


Variable 


.19 

.36** 

.45** 
‘ = .37** 
. 28° .30** 
32° { .40** 
.52** i = 52** 
.22 5 = .37** 


15 .30* 
25 7 7° 
35 .45** 
45 .33* 
15 — 
25 .38** 
35 52** 
45 .32* 


MWIIIAMWAM 
CO bo me CO to 


Note.—1. Average Time on first 14 iterns on Raven's 
PM. 
2. Average Time on second 15 items on Raven's 
PM. 
3. Average Time on third 15 items on Raven's 
PM 
4. Average Time on fourth 15 items on Raven's 
PM. 
5. Number right on complete Raven’s PM 
6. Iowa Teste of Basic Skills 
7. Lorge-Thorndike Intelligence Test 
* Significant at .05 level 
** Significant at .01 level. 


done items. This, if true, should tend 
to lower the reliability of the average 


time scores for this fourth of the test. 
Accordingly, the number of items suc- 
cessfully completed in each fourth of 
the test, and upon which the average 
times were based, was ascertained. 
These, for the successive fourths, were 
found to be 12.7, 7.7, 6.5, and 2.1. 
Thus there is room for doubt that the 
apparent exception to the trend for the 
r’s to increase in magnitude seen at 
the last fourth of the test is genuine. 
When those pupils who got only one 
right or none, were eliminated, the 
mean number right was still only 2.8 
on the last fourth of the test. 

One additional treatment of the data 
for Progressive Matrices was under- 
taken. Median time scores were com- 
puted for each item and one point was 
given for each time score which was 
faster than the median score. These 
points for time were then added to the 
number right score on the PM for each 
pupil and a new score obtained. Scores 
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thus derived were then correlated with 
the criterion measures. Coefficients of 
.35 and .39 were obtained between the 
new PM scores and ITBS and Lorge- 
Thorndike scores, respectively, as 
compared with .217 and .254 between 
the PM number right scores and the 
same two criterion measures. 

The data suggests that speed of re- 
sponse when combined with number 
right on the PM and Leiter increases 
significantly the correlation between 
these tests and the ITBS and Lorge- 
Thorndike scores. 

In one recent investigation an aver- 
age r of .41 was obtained between Pro- 
gressive iMatrices scores and various 
ITBS subtest scores, on 164 fourth 
grade pupils (Knief & Stroud, 1959). 
Most reported correlations that we 
have seen run somewhat higher than 
this. In the present investigation (NV 
= 102), an r of .217 was obtained 
between PM scores (number right) 
and ITBS composite scores and an r 
of .254 between PM scores and Lorge- 
Thorndike verbal scores. Leiter MAs 
(based upon one-half of the items) 
correlated with these same two crite- 
rion measures to the extent of .291 and 
.357. When multiple Rs were computed 
between (a) PM number right and 
average time scores and (b) Leiter 
MA and average time scores and these 
same two criterion measures, values 
of .380 and .420 were obtained for PM 
and of .310 and .460 for the Leiter. A 
coefficient of —.465 was obtained be- 
tween average time values and num- 
ber right scores on PM, and of —.75 
between Raven average time values 
and MAs. 

What the results of this investiga- 
tion tend to show is that the speed 
with which correct responses are made 
on the PM and Leiter tests, when com- 
bined with the conventional scores, 
makes a significant contribution to the 
predictive power of these two tests, as 
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signified by increased correlations with 
the criterion measures. It is true, of 
course, that the correlations are still 
quite low, but the investigation does 
point up the importance of speed of 
response in the measurement of intel- 
ligence. Thus the results support the 
proposition that a person who can per- 
form mental feats, especially difficult 
ones, quickly should be judged to have 
more ability than one who does so 
slowly. 


SUMMARY 


To investigate speed of response as 
a factor in mental measurement, the 
Progressive Matrices and the Leite: 
International Performance Scale were 
administered in individual] sessions to 
102 fifth grade pupils, and a time score 
was determined for each pupil. 

The utilization of ‘the time values 
together with the conventional scores 
resulted in correlations between the 


two tests in question (PM and Leiter) 


and the two criterion tests, the Iowa 
Tests of Basic Skills and the Lorge- 
Thorndike, significantly higher than 
the correlations obtained between the 
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conventional scores alone and the two 
criterion tests. Further analysis of the 
PM data suggested that the contribu- 
tion of the time values increased from 
fourth to fourth of the items, and thus 
with difficulty, through the third 
fourth. 

The results imply that the person 
who is able to deal more quickly with 
intelligence test items has more ability 
than the slower, but equally accurate 
individual. 
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A characteristic of the individual’s 
perceptual or cognitive space which 
saptures much attention in current lit- 
erature—e.g., Bieri (1955), Bieri and 
Blacker (1956), Leventhal (1957), 
Lundy and Berkowitz (1957)—is the 
“complexity-simplicity” of the frame 
of reference within which the individ- 
ual perceives environmental objects. 
Complexity-simplicity can be con- 
ceived as the dimensionality of the 
cognitive space. By dimensionality we 
do not refer to the nature or content 
of the dimensions mediating the re- 
sponse, but only to the sheer number 
of the dimensions used by the indi- 
vidual in discriminating environmen- 
tal objects. This paper examines two 
(a) that training is re- 


hypotheses: 
lated to cognitive dimensionality, and 
(b) so also is anxiety. The tests of 
these hypotheses were set in the con- 
text of teachers’ thinking about prob- 
lems of students. 


Dimensionality and Knowledge 


Let us consider a couple of common 
notions about training or knowledge. 
On the one hand, it is widely held that 
training serves to rule out irrelevan- 
cies. By focusing attention upon what 
is relevant and important, training re- 
stricts the number of criteria by which 
matters are judged. On the other hand, 
a proposition dear to educators is that 
training is liberating; it provides the 
individual with an enhanced reper- 
toire of criteria from which he can 


‘The research reported herein was per- 
formed pursuant to a contract with the 
Office of Education, United States Depart- 
ment of Health, Education, and Welfare 
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select the most appropriate to guide 
his judgment. Whereas the untrained 
individual is more prone to adopt an 
irrelevant dimension or one given by 
his mood of the moment, the individ- 
ual with sufficient training possesses a 
kit bag of relevant dimensions and can 
judiciously select from it dimensions 
suitable in different situations. From 
this point of view training increases 
the number of dimensions which, at 
any given moment, the individual can 
draw upon. 

These two ideas are not contradic- 
tory. The first says that the untrained 
person’s criteria or dimensions of judg- 
ment depend on his mood of the mo- 
ment or upon surface irrelevancies in 
the situation, so that in meeting a 
series of situations he utilizes a large 
number of dimensions. Although he 
might react on the basis only of one or 
very few dimensions in any one situa- 
tion, his dimensions over many situa- 
tions would be numerous. The second 
phase begins when the individual ac- 
quires a little knowledge. He then 
looks for certain relevant and import- 
ant characteristics no matter what the 
situation, so that the tally of dimen- 
sions he uses over a series of situations 
is small. Then with further training, 
the person comes to recognize more 
criteria as relevant to each situation, 
selecting certain ones as more impor- 
tant in some situations and others as 
more important in others; conse- 
quently the dimensionality of his judg- 
ments over situations increases, 

These ideas would lead one to pre- 
dict that the number of dimensions 
likely to be used in a single situation 
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would increase with training. Over a 
series of situations, however, dimen- 
sionality would first decrease and then 
increase as knowledge was acquired 
The particular prediction made in 
terms of our data will be better under- 
stood if we first describe our instru- 
ments and method. 


METHOD 


Teachers in 28 secondary schools in IIli- 
nois were given a questionnaire describing 
twelve imaginary problems which a teacher 
might encounter with students. For each 
problem, the teacher was asked to express 
his preferences among six types of informa- 
tion which he might seek in order to deal 
effectively with the problem. Problem 1, 


along with a condensation of the instructions 
given to respondents, looked like this 


Problem 1 


Joan McCauley has not turned in a single 
assignment since the beginning of the 
vear. You have warned her that failure to 
turn in her homework will result in her 
failing the course, but this has no effect 
She sits and daydreams most of the time 
she 18 in ¢ lass 

As a working guess, where would you say 
the source of this difficulty might lie? To 
check up on your working guess, what 
additional kinds of information would you 
seek? Please number, in order, the types 
of information (no more than three) 


Achievement 
subjects 
Family and 
home life 
Intelligence 
worries 
Personality 


To illustrate further, three more of the prob- 
lems follow 
Virginia Smith’s parents want thei 
daughter to go to college, and Virginia 
herself wants very much to go. However, 
she has no idea what to major in 
Jim has been sent to the principal’s 
office by two different teachers for his 
rude and sarcastic behavior in their classes 
His view of every instance is, “The teacher 
started it.” 
Glen’s teachers 
comes to school so tired every dav 


is always falling asleep in their « 


that the boy 
that he 


asses 


report 
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The school physician reports that he 


basically in good health. 


Each teacher chose three of the types of 
information and ordered them 1-2-3 accord- 
ing to his preference, and he did this 12 
times, once for each problem. Using the 12 
rankings given by a teacher (one ranking of 
three things for each of the 12 problems), it 
was possible to attempt to “unfold” them 
into one dimension according to the tech- 
nique of Coombs (1953) 

Unidimensional unfolding is a method for 
ascertaining whether an obtained rank order 
(or a set of rank orders) might have been 
generated from an underlying order. For ex- 
ample, suppose that a man with a wife and 
two children finds that six houses are avail- 
able on the market, one with a combination 
living and sleeping room, another with one 
bedroom, another with two bedrooms, and 
so on up to five bedrooms. He might most 
prefer the house with three bedrooms, next 
the one with four, and thirdly the one with 
five. When he becomes the father of a third 
child, he might then most prefer the house 
with four bedrooms, then the one with five, 
and thirdly the one with three bedrooms 
Both these rankings of three of the houses 
out of six could have been generated from 
the underlying dimension of the number of 
bedrooms in the houses. But if a man most 
preferred the house with, say, two bedrooms, 
he could not (on the basis of the number of 
bedrooms alone) next prefer the house with 
five—his next choice would have to be either 
the house with three bedrooms or the house 
with one. Thus some responses in rank order 
form are “unfoldable” into the number of 
bedrooms dimension and some are not. A 
more extended discussion of unfolding can 
be found in Coombs (1953) 

An interpretation of unfolding in terms 
of the materials used in the present study 
might be illustrated as follows. Suppose 
that a teacher judged student problems in 
terms of what we might loosely call a 
“hard-soft” dimension. For one problem the 
teacher might feel that very “hard” infor- 
mation was most suitable, choosing first in- 
telligence, then achievement, then interests, 
then family life, etc. On another problem 
the teacher might feel that an intermediate 
type of information was most suitable, 
choosing first interests, then achievement, 
then family life, then intelligence, etc. Both 
these preference orders could unfold into the 
same dimension, as will be seen below. 

The unfolding technique does not, of 
course, depend on guessing what basis the 
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TABLE 1 
ILLUSTRATION OF How THE RESPONSES OF 
ONE SuBsecr TO THE 12 PROBLEMS 
FITTED INTO AN UNFOLDING SET 


Possible ——p orders 
each column shows the 


Type of information 
response to some problem) 


Intelligence 

Interests and ambitions 

Achievement in school sub 
jects 

Personality and character 

Family and home life 

Fears and worries 


Number of problems to 


which subject gave re 


sponse shown in column* 


® Responses of the subject which would not unfold 
Interesta-family- 
fears-intelli 


with the other nine in this set were 
fears, family-interests-personality, and 


gence-interests 


might be using in organizing his 
preferences. The technique is entirely ob- 
jective. As an illustration, the responses of 
one of the subjects are shown in Table 1 
The 1-2-3 entries in the body of the table 
show one set of preference-orders which 
could be generated by the “underlying” 
order of information types listed at the left. 
For any given underlying order of the in- 
formation types, and under the instruction 
to order three out of the six, there are eight 
sets (the table shows only one) of 13 re- 
sponse patterns, each being a set which 
could be generated by the underlying order 


subject 


when the respondent chooses, in order, the 


types nearest his “ideal” type. Eight sets 
are possible because of the effects of relative 
distances among the types; this, as well as 
other details of the unfolding technique, is 
explained by Coombs (1953) 

The response patterns given by our il- 
lustrative subject are indicated at the bot- 
tom of the table. The particular unfolding 
set represented in the table accounted for 
nine of the subject’s responses, and this was 
the most that any unfolding set would ac- 
commodate 

If any one of a teacher’s 12 rankings 
failed to unfold with his others, we knew 
that at least two dimensions were required 
to encompass the 12 responses. We then 
went on to assume that the fewer of the 
teacher’s 12 responses that would unfold to- 
gether, the higher his dimensionality was 
likely to be. This would not necessarily be 


true, of course. But we assumed that it was 
more likely to be true than not 

The maximum number of rankings un- 
foldable into a single dimension was taken 
directly as the individual’s dimensionality 
“score.” Since there were 12 problems, the 
dimensionality score could range from 1 to 
12. A large number of unfoldable responses 
means low dimensionality, and vice versa 
Actually, the obtained scores ranged from 3 
(high dimensionality) to 10 (low dimension- 
ality). If a teacher gave an unusable re- 
sponse to than one problem, he was 


oded NA and not given a dimensionality 


more 


score 

The unfolding technique 
rough index of whether the 
using relatively few or relatively more di- 
mensions in thinking about the types of in- 
formation he would need in dealing with the 
problems described to him 

4s a measure of training influences, we 
used a 60-item test developed in the course 
of our larger study: a test of Knowledge 
nd Interpretation of Tests (KIT). We did 
not want a measure of years of experience 
in dealing with information about students 
since, as it is often phrased, 10 years’ ex- 
perience often consists of 1 year’s experience 
Nor did we want a 
exposure to 


thus gave us a 
teacher was 


repeated 10 times over 
direct mea amount of 
training, since there are great individual dif- 
degree to which training 
“takes,” est when assessed a year or 
more after the last training 
Consequently, we wanted what might be 
called a measure of the residual effects of 


sure of 
ferences in the 
especl ally 


exposure to 


training 

Some of the types of information offered 
typically ob- 
through the use This cir- 
together with the fact that train- 
of information about students 


were types 


the respondent 
tained of tests 
umstance, 
ing in the use 
usually includes training in constructing and 
interpreting tests, persuaded us that for the 
purposes of our hypothesis a measure of 
knowledge testing would suffice to 
index the which the individual’s 
training would affect his tendencies in the 
use of information about students. Conse- 
quently, scores on the KIT were distributed 
dimensionality scores to test the 
that increased training is 
lifferent dimensionalities 
KIT are given 


about 
extent to 


against the 
hypothesis 
ciated with 


4a580- 
Some 
representative items from the 
below 

In counseling junior high school stu- 
teacher should be most cautious 
interpretation of the information 


dents a 
in her 
she obtains from 
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\. vocational interest tests 

B study skills tests 

C. reading comprehension tests 
D. performance tests 


\ student scored at the 75th percentile 
on a standardized achievement test. This 
means that: 

A. 75% of the norm group scored lower 
than he did 

B. 75% of the norm group scored higher 
than he did 

C. he answered 

orrectly 

D. he 


igh school class 


75‘ of the questions 


is in the upper 25% of his own 


On a group intelligence test, which pu- 
pil would be most apt to receive an IQ 
that is much lower than his true ability? 

A. Mary, whose parents speak only 
Spanish 

B. John, who failed in all of his school 
subjects last year 

C. Jane, who comes from a lower mid- 
dle class home 

D. Bill, who spends all of his time in 
ithletics instead of on his school work 


The question arises what kind of relation 
should be predicted between our two meas- 
ures—dimensionality (number of mutually 
unfoldable rankings) and training (score on 
the KIT). Can we specify precisely where, 
within the ranges covered by our measures, 
dimensionality should increase or decrease? 
We mentioned earlier that the predictions 
would be different if we were looking within 
2 single situation or if we were looking at a 
series of situations. Was answering the Prob- 
lems Questionnaire a single situation for our 
subjects, or was it a series of 12 situations? 
We could hardly know in advance 

Another difficulty in choosing a predic- 
tion was the range of the KIT. There was 
no way of determining in advance whether 
it extended high enough to reach the hy- 
pothesized point where dimensionality 
would begin to rise. Because of these un- 
certainties, we could not pick out a precise 
form of relation to predict. If the question- 
naire were a single situation and the range 
of the KIT were too low, we could expect 
no relation at all to show up. Hf the ques- 
tionnaire were a series of situations and the 
range of the KIT were moderate, we could 
expect dimensionality to decrease with 
knowledge. But if the KIT were ample in 
range, we could expect first a decrease in 
dimensionality and then an increase. We 
hoped that our instruments were adequate, 
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and adopted the latter relation as our Hy- 
pothesis 1: Dimensionality in responses to 
the Problems Questionnaire will first de- 
crease and then increase with score on the 


KIT 
RESULTS 


Hypothesis 1 


Dividing the KIT scores into six in- 
tervals containing as nearly equal 
numbers of respondents as possible 
and entering the dimensionality scores 
for each KIT interval, we obtained the 
results shown in Table 2; males and 
females are tabulated separately. 

The means shown in Table 2 are 
plotted graphically in Figure 1. Both 


TABLE 2 
FREQUENCIES OF DIMENSIONALITY Sconzs 


KIT scores 

Males only = 
Dimensionality 14 lay 33-| 37 
| 23 29 | 32 | 36 | ss | Total 


2 34 130 
6.4 6.7) 5.8) 5.8 


KIT scores 


Females only 
Dimensionality 


~|27 ~ | 39~ | 
j= 27- | 30- | 32-| 35! potas 


29 | 31 | | 46) 


1 
13 
uM 
49 
23 
16 

2 

3 


18 (23 (21 (25 (26 (28 141 
5.3) 5.5) 6.7 6.4) 6.1) 6.3 


Note.—Chi square tests from tables collapsed to 3 
3: Males x* = 11.13, p < .026; Females x* = 15.80, p < 
005 
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Dimensionality 
High bs) 
6 


6. 


14-23 


Dimensonality 
High 5 
5 


5 


10-22 


Fic. 1 


curves dip in the middle with a grati- 
fyingly high level of statistical con- 
fidence, and their general shape is rep- 
licated for males and females. Our 
theory suggests that the high dimen- 
sionality of the low KIT scorers rep- 
resents a haphazard hopping from one 
dimension to another in going from 
problem to problem, whereas the mod- 
erate to high dimensionality of the 
KIT flatter 
eurselves—is the differentiated cogni- 
tive structure of the expert. The rela- 
tively low dimensionality of respond- 


high scorers—so let us 


ents with average knowledge might be 
called the simple sophomoric world of 
educated. 


the semi 


24-26 


23-26 
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27-29 30-32 33-36 37-55 


KIT scores 


27-29 3S-3s 32-34 35-46 


KIT scores 


Mean dimensionality at successive KIT levels 


Anxiety and Dimensionality 


There is evidence in the literature 
that anxiety focuses or narrows the as- 
pects of the environment to which the 
organism responds, Easterbrook (1959) 
is particularly cogent on this point. 
Now, one way in which perception or 
attention can be focused is by reducing 
the number of dimensions along which 
environmental are discrimi- 
nated; and our dimensionality measure 
is meant to indicate, roughly, just this: 
that the types of information pre- 
nted to the teacher were discrimi- 
nated along more or fewer dimensions 
We should therefore predict (Hypoth- 
is 2) that teachers with higher anx- 


objects 


Senter 
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iety would show lower dimensionality 
than those with lower anxiety when 
responding to the problems. 

Our measure of anxiety 
‘Self-Perception Checklist” 
formed part of a questionnaire used in 
our larger study. It was made up of 
selected items from the Guilford-Zim- 
merman Temperament Survey (1949)? 
and from Saunders’ Personality Re- 
search Inventory (1955). After the re- 
turns were in, these items were ana- 
lyzed for homogeneity. Thirteen 
proved to have tetrachoric r’s with 
total score of .40 or better, and these 
were used to make up the total score 
on anxiety This score was merely the 
count of items answered according to 
the key for “security” as opposed to 
anxiety, high scores indicating security 
and the low scores anxiety, the two 
terms being meant to label a polarity. 
This short test was admittedly an un- 
reliable instrument and subject to var- 
ious faults such as social desirability 
answers; nevertheless, it was the best 
compromise we could make at the time 
with costs of administration, respon- 
dent fatigue, etc. Some examples of 
items are these: 

Do you frequently get into a state of ten- 
sion and turmoil by thinking over the day’s 
happenings? 

Have you usually been optimistic about 
your future? 

Are you able to criticize people without 
hurting their feelings? 


was the 
which 


H ype thesis 2 


When we distributed the security 
scores against dimensionality with all 
teachers pooled the result was about 
as near random as one could get. How- 
ever, since neither of these measures 
was expressly designed to give a pow- 
erful test of the hypothesis we decided 
to look further for ways of selecting 

* Used by permission. We used items from 


the Guilford-Zimmerman which had been 
selected in 1954 by Jay M. Jackson 
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respondents for whom the security and 
dimensionality measures would be 
more discriminating. 

Other work carried out by Gerald 
Larson (unpublished) as a part of the 
larger study had suggested that our 
security measure was more valid for 
males than for females. Also, as Table 
2 shows, the KIT was not only asso- 
ciated with differences in dimension- 
ality, but the spread of dimensionality 
scores was somewhat greater for the 
middle group of KIT scores. Accord- 
ingly, we distributed security against 
dimensionality for each of the six 
groups formed by sex and three levels 
of KIT. The results for males are 
shown in Table 3; the results for fe- 
males were nowhere significant, and 
are not reported. 

For males, results remained random 
at low and high levels of KIT but be- 
came significant in the middle range 
In brief, no subgroup of respondents 
showed a relation contrary to hypoth- 
and one subgroup, selected for 
sensitivity to our unreliable measures, 
showed the predicted relation at a 
good level of confidence. As the center 
subtable of Table 3 shows, relatively 
more of the secure male teachers ex- 
hibited high dimensionality and rel- 
atively more of the insecure showed 
low dimensionality. 


Security vs. KIT 


Because both knowledge and anxiety 
showed some relationship to dimen- 
sionality we investigated their relation- 
ship with each other. Only random re- 
sults were obtained for females, but for 
males the relationship was monotonic. 
This result is reported in Table 4, 
where it is shown that more knowl- 
edgeable males tend to be more secure 
than do knowledgeable ones. 
Whether the more secure males were 
those who took courses in testing and 
learned more from them or whether 


€s18; 


less 
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TABLE 3 
DIMENSIONALITY v8. SECURITY WITHIN 
KIT Leve.s 

Males Only 


Security 
Dimensionality ne 
Low High 
0-10) 11-13 


KIT of 10-25 


_High 4-5 
6 


Low i-9 


Total 
x? corrected for continuity = 0.32; ns. 


KIT of 26-35 


High 7 11 
4 15 
Low 
Total 
x? = 8.54, p < .01 (one-tailed). Itali- 
cized cell frequencies are higher than 
randomly expected. 


KIT of 36-54 


10 14 
5 10 
9 11 


24 35 


x? corrected for continuity = 1.33; ns. 


they became more secure after acquir- 
ing more knowledge about testing is, 
of course, undetermined. 


SUMMARY 

This paper is concerned with the 
effect of knowledge and of anxiety 
upon certain aspects of cognitive di- 
mensionality. Dimensionality is here 
defined as the total number of dimen- 
sions or preference factors a person 
employs in perceiving and evaluating 
specified complexities of environmen- 
tal stimuli. Individuals with high di- 


mensionality employ a sizable number 
of dimensions in dealing with such 
stimuli; those with low dimensionality 
employ relatively few. 

In this research the stimuli con- 
sisted of six general kinds of informa- 
tion a teacher might select for use in 
working with students who presented 
problems typical of those frequently 
encountered in the classroom. Our aim 
was to investigate whether differences 
in teachers’ knowledge about such 
matters, and also whether differences 
in teachers’ personal feelings of secu- 
rity, affected cognitive dimensionality 
in ways consistent with those theorized 
in current literature. 

Hypotheses long held by educators 
combine to assert that training, by 
serving to increase knowledge, at first 
restricts and later enlarges the indi- 
vidual’s cognitive framework. The un- 
trained person, having no established 
framework, gives responses primarily 
determined by the situation. Training 
first serves to decrease this variability 
by providing a few specific ways of 
perceiving these stimuli regardless of 
the situation, and later serves to en- 
rich cognitive dimensionality by pro- 
viding the person with knowledge that 
equips him with more criteria for dis- 
criminating the stimuli. The signifi- 


TABLE 4 
Security vs. KIT 
Males Only 


Security 


10 
il 


2-9 
36-5 : 5 ll 
26-35 12 
10-2 10 10 

Total 22 3 33 
Note.—Critical ratio by J. E. K. Smith’s (1956 

monotonicity test is 2.35; p < .02 (two-tailed). 





TRAINING, ANXIETY, AND TEACHERS’ PERCEPTIONS 


cant curvilinear relationship found be- 
tween teachers’ knowledge of testing 
and teachers’ perceptions of student 
problems strongly supported this hy- 
pothesis. Teachers with low and high 
levels of knowledge possessed high di- 
mensionality: a finding we interpreted 
as indicating erratic versus specialized 
and differentiated perceptions. By 
contrast, teachers with average know!l- 
edge possessed relatively low dimen- 
sionality, which we interpreted as in- 
dicative of the restricted simplicity of 
the partially trained individual. 
Another body of theory states that 
feelings of anxiety serve to narrow 
perception to a few elements of the 
environment. We reasoned that, if 
true, such narrowing would be re- 


flected in a reduction of the number of 
dimensions the anxious individual em- 
ploys in dealing with his environment. 
This hypothesis was supported by a 
part of our data. No relation between 
anxiety and dimensionality was found 
for female teachers, but a significant 


one was found for male teachers who 
possessed knowledge in the middle or 
average range. We believe that more 
reliable measures of anxiety and of 
dimensionality might provide stronger 
support for this second hypothesis. 
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LEARNING IN FOURTH AND SIXTH GRADERS AS 
A FUNCTION OF SENSORY MODE OF STIM- 
ULUS PRESENTATION AND OVERT OR 
COVERT PRACTICE’ 


JOAN LOCKARD 


University of Wisconsin 


A number of studies have indicated 
a relatively consistent trend for sub- 
jects to learn more efficiently when 
material is presented simultaneously 
to two sensory channels (auditory + 
visual) than when a single sensory in- 
put is used (Day & Beach, 1950). 
When auditory versus visual modal- 
ities are considered, however, results 
are conflicting. Interpretation of the 
results is further complicated by the 
interaction of sensory input variables 
with other variables. Early studies in- 
dicate that auditory presentation of 
material is more effective than visual 
for relatively young children (third, 
fourth, and fifth grades) but that the 


trend reverses as age increases (Erick- 
son & King, 1917; Russell, 1938). Sev- 
eral recent studies (Evans, Glaser, & 


Homme, 1960; Silverman & Alter, 
1960) , investigating response modes in 
automated instruction with college 
students, have suggested that the re- 
quirement to write a response may be 
less effective in learning than merely 
reading the same material. The pres- 
ent study, therefore, was designed in 
order to investigate the influence of 
three modes of stimulus presentation 
(auditory, visual, and auditory + vis- 
ual) and two modes of responding 
(overt or covert) upon learning in 
fourth and sixth grade children. 


* The authors wish to express their sincere 
appreciation to Robert Nardelli, Principal of 
the Campus Laboratory School, San Diego 
State College, for his cooperation during the 
course of the experiment. 
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METHOD 


Eighteen fourth and 18 sixth 
grade children from the Campus Laboratory 
School at San Diego State College served as 
subjects. The mean IQ (California Tests for 
Mental Maturity) for the fourth grade was 
119.7, and for the sixth grade, 1246. 

Procedure. Students in both grades were 
required to learn lists of nonsense syllables 
under each of three sensory modes of stimu- 
lus presentation: visual, auditory, and visual 
+ auditory. The subjects in each grade 
level were randomly assigned to two response 
subgroups, overt or covert, consisting of nine 
subjects each. In the overt response condi- 
tion, subjects were required to recall and 
write down the syllables after each of 14 
trials. The covert groups merely learned the 
syllables and were given a written recall test 
only after the fourteenth trial. A trial was 
defined as one complete presentation of the 
list of 10 syllables. 

Five lists of nonsense syllables, two prac- 
tice and three experimental, taken from Glaze 
(1928) and of high association value (87- 
100%) were used. In order to keep intralist 
similarity at a minimum, a different con- 
sonant s.arted each of the syllables in a list 
and vowels were used about equally often 
Each list consisted of 10 syllables. An earlier 
study by Sidowski and Eason (1960) indi- 
cated no significant difference in difficulty 
between the lists. Each list was presented for 
a total of 14 trials in each condition. Syllables 
were presented at a 2-second rate with a 2- 
second interval intervening between the pres- 
entation of each syllable. The syllables were 
spelled out during the 2 seconds for the audi- 
tory conditions by means of a Webcor tape 
recorder. Visual stimuli were presented at eye 
level by an American Optical Performance 
500 projector at a distance of approximately 
8 feet from the seated subject. The inter- 
trial interval was 30 seconds for all condi- 
tions. Each subject in the overt groups was 
required to write down all of the nonsense 
syllables that he remembered during this in- 
terval on each of the 14 trials. Subjects in the 
covert groups merely sat and waited for the 


Subjects. 


? 
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next trial. All subjects were instructed to re- 
member as many of the syllables as possible 
they would be tested after going 
through the list 14 times. After Trial 14, sub- 
jects in all groups were allowed as much time 
as was needed to recall and write down the 
syllables 

Design Each subje *t served in the experi- 
ment one hour per day for 4 consecutive 
lays. The first day was a practice day during 
which the subject learned one practice list 
auditorily and a second visually. On each of 
the following 3 days, learning was carried out 
under one of the three experimental sensory 
conditions. The presentation of the sensory 
variables and the three experimental lists 
were counterbalanced within the design, as 


since 


were the presentations of the practice ndi- 
tions 

At the conclusion of the 
subject was required to rank the three sen- 
sory variables from the least preferred to the 
most preferred. 


+} 


Luc 


experiment, 


RESULTS AND DISCUSSION 
The mean number of errors in recall 
are presented in Table 1 for all con- 
ditions. (An error was defined as an 
incorrect recall as well as a failure to 


recall.) An inspection of the data in- 


dicates a consistent superiority for the 
visual, and visual + auditory presen- 
tations for the overt practice condi- 
tion. This superiority is consistent for 
both grade levels. The covert practice 
condition appears superior for the 
sixth graders with little differentiation 
at this grade level between the sensory 
variables 

An analysis of variance was carried 
out on the data for Trial 14 since re- 
call measures were taken during this 
trial for the overt and covert condi- 
tions. The results of the analysis are 
presented in Table 2. A significant 
overall difference was found between 
the sensory modes of stimulus presen- 
tation, while the Grades x Response 
Type interaction showed an F of 4.11, 
with an F of 4.15 being required at the 
5% level. Analysis of the sensory 
mode variable indicated that the au- 
ditory presentation of stimuli was sig- 


MODE OF PRESENTATION 


263 


TABLE 1 

Mean NuMBER or Errors iN RECALL FOR 
Overt anp Covert RESPONSE 

CoNnDITIONS 


Response groups 


Overt Covert 


Trial 1 | Trial 14 | Trial 14 


Grade 4: 

Auditory 

Visual 

Auditory + Visual 
Grade 6 

Auditory 

Visual 

Auditory + Visual 


0.07 
0.07 


nificantly inferior in recall to visual 
but not significantly different from au- 
ditory + visual. 

It was decided beforehand to carry 
out two additional statistical analyses. 
A separate analysis was carried out 
on the covert response groups and the 
results indicated: (a) fourth graders 
producing significantly more errors 
than sixth graders, (6) no significant 
difference between sensory modes for 
the sixth grade, and (c) for the fourth 
grade, auditory presentation produc- 
ing significantly more errors (p < .05) 
than visual. A final analysis of vari- 
ance was carried out on Trial 1 for 
the overt response condition. The re- 
sults indicated a significant sensory 
mode effect (F = 7.95, df = 2/32, p 
< .01) with auditory presentation 
showing significantly more errors than 
either of the other sensory modes for 
both grade levels. 

It is obvious that the results of the 
present study do not agree with thos« 
of earlier studies (Erickson & King, 
1917; Russell, 1938) which indicate a 
superiority for the auditory method 
for younger children. In the earlier 
studies, however: (a) more meaning- 
ful material was used, (b) the audi- 
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TABLE 2 


ANALYSIS OF VARIANCE FOR ERRORS IN 
RECALL ON TRIAL 14 


Grades (G) 
Response types (RT) 
G X RT 
Subjects within 

groups 
Sensory modes (SM) 
SM X,G 
SM xb 
SM Xj{RT X G 
Error 

Total 


*p= Ol. 


tory presentation of material consisted 
of class lecture and/or reading by a 
status figure, and (c) less stringent 
controls were exercised over the ex- 
perimental environment. One of the 
advantages inherent in the use of the 
visual method for presenting nonsense 
syllables is that the letters for any 
three letter syllable are presented si- 
multaneously. With the auditory 
method, each of the letters is spelled 
serially thus requiring the subject to 
organize the letters in the syllable 
while learning (Krawiec, 1946). Evi- 
dently the covert condition allowed the 
sixth graders to learn and organize the 
material better than the overt method 
for all modes of stimulus presentation. 
This was not true for the fourth 
graders, although the younger children 
had little difficulty in recalling the ma- 
terial as well as the sixth graders when 
written responses were required after 
each trial. 

The results of the preference rank- 
ings of the three sensory modes paral- 
leled those of the error score analyses. 
The visual and auditory + visual 
modes were preferred significantly 
more than the auditory mode, with 
little preferential difference being in- 
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dicated between the two visual condi- 
tions. 


SUMMARY 


The learning of nonsense syllables 
by fourth and sixth graders was in- 
vestigated as a function of: (a) three 
modes of stimulus presentation (au- 
ditory, visual, and auditory + visual) ; 
and (b) two response types, overt 
(written) and covert (nonwritten). 

All subjects were required to learn 
a list of nonsense syllables under each 
sensory mode of stimulus presenta- 
tion. Each list was presented for 14 
trials under all conditions. Half of the 
subjects in each grade recalled and 
wrote out as many of the syllables as 
possible after each of the 14 trials 
(overt group). The remaining subjects 
merely observed and learned the syl- 
lables for 14 trials with no written re- 
call responses (covert). After the 14 
trials, subjects in all groups were given 
as much time as was needed to recall 
and write out the syllables. 

Analyses of the data indicated a sig- 
nificant superiority for the visual and 
auditory + visual methods of stimulus 
presentation. No significant difference 
was found between the fourth and 
sixth graders for the overt response 
condition. For the covert groups, how- 
ever, the fourth graders recalled sig- 
nificantly fewer syllables than the 
sixth graders. 


REFERENCES 


Day, W. F., & Beacu, B. R. A survey of the 
research literature comparing the visual 
and auditory presentation of informa- 
tion. USAF tech. Rep., 1950, No. 5921. 
Wright-Patterson Air Force Base, 
(Dayton, Ohio). 

E.uiot, F. R. Memory for visual, auditory 
and visual-auditory material. Arch. Fs;- 
chol., NY , 1936, 29, No. 199. 

Erickson, C. I., & Kiva, I. A comparison of 
visual and oral presentation of les«uns in 
the case of pupils from the thirc to the 
ninth grade. Sch. Soc., 1917, 6, 146-148 





LEARNING AND SENSORY 


Evans, J. L., Giaser, R., & Homme, L. E. A 
preliminary investigation of variation in 

properties of VE rbal learning se- 
quences of the “teaching machine” ty pe 
In A. A. Lumsdaine & R. Glaser (Eds.), 
Teaching and programmed 
learning: A book. Washington, 
D.C National Education Association, 
1960. Pp. 446-451 

Guaze, J. A 


the 


machines 


source 


The association value of non- 
1928, 


sense syllables. J. genet. Psychoi., 
35, 255-267 

Krawiec, T.S. A comparison of 
retention of materials presented visually 


J gen Psy hol 


learning and 


and auditorily 1946, 


34, 179-195 


MODE OF PRESENTATION 265 

Lumuey, F. H. Research in radio education 
at Ohio State University. In, Education 
on the air: Fourth yearbook of the in- 
stitute education by radio. Colum- 
bus: Ohio State University, 1933 
ssetL, R. D. A comparison of two methods 
of learning. J. educ. Res., 1938, 18, 235- 
239 

SipowskI!, J. B., & Eason, R. G. Drive, verbal 
performance, and muscle action poten- 
tial. J. exp. Psychol., 1960, 60, 365-370 

SrtverMAN, R. E., & Avrer, M. Note on the 
response in teaching machine programs 


Psychol. Re DP. 1960, Se 496. 


for 


(Received April 5, 1960) 





Journal of Educational Psychology 
1961, Vol. 52, No. 5, 266-274 


THE ROLE OF DISCRIMINABILITY IN MEANING- 
FUL VERBAL LEARNING AND RETENTION 


DAVID P. AUSUBEL ann DONALD FITZGERALD 


ureau of Educationa esearc! Iniversity o inois 
B f Educat LR h, ty of Ill 


In a recent study (Ausubel, 1960), 
it was shown that introductory mate- 
rial at a high level of abstraction, gen- 
erality, and inclusiveness (advance or- 
ganizers) facilitates meaningful verbal 
learning and retention. By deliberately 
introducing relevant and appropri- 
ately inclusive subsuming concepts 
into cognitive structure, one provides 
helpful ideational scaffolding which 
enhances the incorporability and lon- 
gevity of the more detailed material in 
the learning passage. 

Advance organizers, however, or- 
dinarily have two distinct functions 
that correspond in turn to two differ- 
ent aspects of the unfamiliarity of 
meaningful learning material. Some- 
times, as in the above mentioned ex- 
periment, the new material is almost 
completely unfamiliar in the sense 
that cognitive structure is barren of 
even generally related concepts. Under 
these circumstances the purpose of the 
organizer is simply to provide idea- 
tional anchorage or scaffolding. More 
typically, however, the new learning 
material (e.g., Buddhist doctrines) is 
a variant of related, previously learned 
concepts (Christian doctrines) already 
established in cognitive structure. 
Here the role of the organizer is not 
only to provide optimal anchorage at 
an optimal level of inclusiveness, but 
also to increase the discriminability of 
the learning passage from analogous 
and often conflicting ideas in the 
learner’s cognitive structure 

This second role of organizers is 
predicated on the assumption that if 
the distinguishing features of the new 
learning passage are not originally sa- 


lient or readily discriminable from es- 
tablished ideas in cognitive structure, 
they can be adequately represented 
by the latter for memorial purposes, 
and hence would not persist as sep- 
arately identifiable memories in their 
own right. It is assumed, in other 
words, that only discriminable cate- 
gorical variants of previously learned 
concepts have long-term retention po- 
tentialities. Thus, if a comparative 
type of organizer could first delineate 
clearly, precisely, and explicitly the 
principal similarities and differences 
between the new learning passage 
(Buddhism) and existing, related con- 
cepts in cognitive structure (Chris- 
tianity), it seems reasonable to sup- 
pose that the more detailed Buddhist 
ideas would be grasped later with 
fewer ambiguities, fewer competing 
meanings, and fewer misconceptions 
suggested by the learner’s knowledge 
of Christianity; and that as these 
clearer, less confused Buddhist mean- 
ings interact with analogous Chris- 
tianity meanings during the retention 
interval, they would be more likely to 
retain their identity. In this experi- 
ment, therefore, the value of a com- 
parative organizer was tested by con- 
trasting its effects on the retention of 
a Buddhism learning passage with 
both those of a nonideational (histor- 
ical) introduction and those of a sim- 
ple expository organizer. 

It is hypothesized, first, that to the 
extent that the organizer is rendered 
discriminable from related concepts 
(Christianity) established in cognitive 
structure, and hence to the extent that 
it increases the discriminability of the 
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Buddhism learning passage from these 
Christianity concepts, it facilitates the 
learning and retention of the new 
Buddhist. ideas. In addition, it is hy- 
pothesized, for analogous reasons, that 
the discriminability (and hence the 
learning and retention) of the Bud- 
dhism passage varies as a function of 
the clarity and stability of the learn- 
er’s existing knowledge of Christian- 
ity, and that subjects with relatively 
unclear and unstable concepts of 
Christianity derive relatively more 
benefit from the organizers than do 
subjects with clear and stable concepts 
in this area of knowledge. 

These hypotheses were suggested by 
the findings of a previous experiment 
(Ausubel & Blake, 1958) in which the 
learning and retention of a compara- 
tive Buddhism passage were con- 
trasted with that of an expository 
Buddhism passage. However, for the 
following reasons, the organizer ap- 
proach was adopted in this experi- 
ment, in preference to manipulating 
the learning material itself: First, or- 
ganizers provide advance ideational 
scaffolding. Second, they provide the 
learner with a generalized overview of 
all of the major similarities and dif- 
ferences between the two bodies of 
ideas before he encounters the new 
concepts individually in more detailed 
and particularized form. Finally, 
they create an advance set in the 
learner to perceive similarities and 
differences, and, by avoiding overly 
explicit specification, encourage him 
actively to make his own differentia- 
tions in terms of his own particular 
sources of confusion. 

The hypotheses advanced in this 
study apply only to meaningful learn- 
ing material which, although un- 
familiar to subjects, is relatable to 
long-established and relatively stable 
concepts in cognitive structure. They 
do not apply to rote learning, to com- 
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pletely unfamiliar learning material, 
or to learning tasks that can only be 
related to unstable or recently learned 
concepts. The organizers, further- 
more, must consist of ideational ma- 
terial (both similarities and differ- 
ences) at a high level of abstraction, 
generality, and inclusiveness, rather 
than constitute a simple summary or 
a mere listing of specific comparative 
points. 


METHOD 


Subjects 

The experimental population consisted of 
predominantly senior undergraduate students 
(94 women and 61 men) in six sections of an 
educational psychology course at the Uni- 
versity of Illinois. All subjects were enrolled 
in one of 10 teacher education curricula at 
the secondary school level. The experiment 
was conducted separately in each section as 
a required laboratory exercise, and was per- 
formed during regularly scheduled class 
hours. In order to maximize ego involvement, 
subjects were informed that after the data 
were processed their individual scores, as well 
as the class results, would be reported to 
them 


Learning Passages, Organizers, and 
Measuring Instruments 


The learning material used in this study 
was a specially prepared 2,500-word passage 
dealing with Buddhist concepts of God, im- 
mortality, soul, faith, salvation, morality, 
and responsibility. These concepts were elab- 
orated in considerable detail. The passage 
only presented the significant ideas of Bud- 
dhism and ignored material on the life of 
Buddha, the history and geographical distri- 
bution of Buddhism, schools of Buddhism, 
and Buddhist ritual. Flesch analysis of the 
passage yielded an abstractness score of 19.19 
(highly abstract) and a readability score of 
12.46 (difficult) 

The topic of Buddhism was chosen both 
because it was explicitly unfamiliar to under- 
graduate students, and because it dealt with 
variants of previously learned concepts (i.e., 
Christian doctrines) generally familiar to all 
of our subjects and, presumably, reasonably 
well-established in the cognitive structure of 
most of them. Both criteria were important 
since the main purpose of the study was to 
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ascertain whether advance organizers could 
facilitate the learning and retention of un- 
familiar meaningful material by increasing 
the discriminability between the new ma- 
terial and related concepts already estab- 
lished in cognitive structure. The use of un- 
familiar learning material made it 
possible for all subjects to start from ap- 
proximately the same base line in learning 
the passage. Empirical confirmation of the 
unfamiliarity of the Buddhism material was 
obtained when a group of comparable sub- 
jects, who had not studied the learning pas- 
sage, made scores which, on the average, were 
only slightly and not significantly bette: 
than chance 

Still another adfantage of the Buddhism 
fact that its learn- 
uninfluenced in our 


also 


material inhered in the 


ability was relatively 


population by such factors as sex, field of 
specialization, and variability in relevant in- 


cidental experience. It is true that women 
subjects made significantly higher scores than 
men both the Buddhism and 
Christianity tests. This superiority, however, 
was not a function of differential background, 
interest, or motivation related tu sex per se, 
but reflected significantly superior academic 
aptitude as measured by verbal score on the 
School and College Ability Test (SCAT) 
Knowledge of the Buddhism material was 
tested 3 and 10 days after learning, by equiv- 
alent forms of a 45-item multiple-choice 
test with corrected split-half reliabilities of 
80 and The correlation of 
the 3- and 10-day retention scores was .79 
This latter figure indicated both relatively 
high stability over time, in view of the dif- 
ferent (3- versus 10-day) retention abilities 
involved, as well as a high degree of relation- 
ship between the two retention abilities. Test 
questions covered principles, facts, and ap- 
plications, and were selected by an item 
analysis procedure from a larger population 
of items. Scores on both tests showed a satis- 
factory range of variability and.were distrib- 
uted normally. Since they were intended as 
power tests, no time limit was imposed 
Three types of introductory passages were 
used in this experiment, each about 500 words 
in length The comparative organizer pointed 
out explicitly the principal similarities and 
differences between Buddhist and Christian 
doctrines. This comparison was presented at 
a much higher level of abstraction, general- 
ity, and inclusiveness than the Buddhism pas- 
sage itself, and was deliberately designed to 
discriminability between the two 
sets of concepts. The expository organizer, 
on the other hand, merely presented the 


subjects on 


79, respectively 


increase 
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principal Buddhist doctrines at a high level 
of abstraction, generality, and inclusiveness, 
without making any reference whatsoever to 
Christianity. It was not explicitly designed 
to increase discriminability between the two 
religions, but merely to provide some general 
ideational scaffolding for the detailed Bud- 
dhist material. The historical introduction 
was intended solely as a control treatment 
It contained interesting historical and human 
interest material about Buddha and Bud- 
dhism, but neither provided any ideational 
scaffolding nor attempted to compare Bud- 
dhism and Christianity. No information was 
included in any of the introductory passages 
that could constitute a direct advantage in 
unswering questions on the Buddhism test 

It was methodologically important to 
provide an historical introduction for the 
control group in order that any obtained dif- 
ferences in retention outcomes between ex- 


] 


perimental (comparative) and control (his- 


torical) groups could be attributed to the 
particular nature of the 
ganizer (1L¢ 
criminability) rather than to its presence per 
se. The of exposing another group 
of subjects to an ¢ xpository introduction was 
whether the 


comparative or- 
to its enhancing effects on dis- 
pur} OS¢t 
to determine 


comparative or- 
ganizer could increase the discriminability 
of the learning passage over and 
which could be attributed to the influence of 
a simple organizer (i.e., to the mere provision 
of advance ideational seaffolding) 

4 36-item multiple-choice test on Christi- 
unity was used to measure variability among 
our subjects with respect to the stability and 
clarity of those existing (Christianity) con- 
cepts within cognitive structure which were 
analogous to the Buddhism learning material, 
and hence potentially interfering. Test items 
were noncontroversial, dealing with Old and 
New Testaments, church history, and de- 
nominational beliefs and differences. The 
scores on this test were normallv distributed 
and the corrected split-half reliability was 
SM 

Scores on the verbal portion of the SCAT 
were available for 65 subjects. This test had 
been previously administered as part of a 
battery of entrance examinations for in- 
coming university freshmen 


Procedure 


On the first day of experimentation, all 
subjects took the Christianity test and then 
(after assignment to a treatment group) 
studied one of the three kinds of introduc- 
tions for 8 minutes. Membership in a treat- 


ibove that 


ment (comparative, expository, or 


group 
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historical) was determined by random assign- 
ment. The population of each of the three 
treatment groups was also stratified by sex 
so that the proportion of men to women sub- 
jects would be the same in each group. This 
was necessary because of the women’s sig- 
nificantly higher verbal SCAT scores. It was 
possible to administer all three treatments 
simultaneously because they consisted of 
identical appearing introductory passages 
(with identical sets of directions), differing 
only in content 

To equalize the possible effects of prior 
extended exposure to the Buddhism material, 
those few subjects (5% of the total) who had 
taken a course in comparative religion were 
equally distributed in random fashion, among 
the three treatment groups. It had also been 
assumed that random assignment of subjects 
would render the different treatment groups 
equivalent with respect to such factors as 
learning ability and knowledge of Christian- 
ity. This assumption was confirmed empiri- 
cally by the finding that differences between 
these groups on SCAT and Christianity test 
scores were negligible 

In order to control for the effects of dif- 
ferent instructor, situational, and classroom 
climate variables in the six sections, students 
vithin section were equally divided 
umong the three treatment groups. Since 
analysis of the data showed that homogeneity 
of variance prevailed, both on an intersec- 
tional as well as on an intergroup basis, for 
both the Christianity test scores and the two 
sets of Buddhism test scores, it was consid- 
ered justifiable to treat the 
three treatment groups on each of these in- 
struments as comparable random 
from the same population 

Two days after studying their designated 
introductions, all subjects read and studied 
the same Buddhism passage for 35 minutes 
One form of the Buddhism test was admin- 
istered to all subjects 3 days later, and an 
equivalent form of the same test 
ministered one week after the first 
10 days after the learning passage 

\ special randomly assigned control group 
of subjects was constituted out of the six 
sections, along the same lines described above 
for the three treatment groups. The proce- 
dure followed with group was 
identical with that used for the comparative 
group except that subjects studied a 1,800- 
word passage on the endocrinology of human 
pubescence instead of the Buddhism passage 
The purpose of this procedure was to ascer- 
tain to what extent mere knowledge of the 
c ymmparative organizer (without anv expo- 


é ach 


scores of the 


samples 


was ad- 
test, or 


this special 
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sure to the Buddhism learning passage itself) 
could increase scores on the Buddhism tests 
beyond chance expectancy 


RESULTS AND DISCUSSION 


Comparison of corresponding 3- 
and 10-day means of total treatment 
groups shows that retention loss dur- 
ing this interval was relatively slight. 
The loss was greatest in the historical 
group (p = .05), least in the exposi- 
tory group, and intermediate in the 
comparative group (p < .10). This 
low degree of retention loss is prob- 
ably attributable both to the nega- 
tively accelerated shape of most re- 
tention curves, particularly in the 


of meaningful material, and to 
the “rehearsal effect” of the 3-day 
Buddhism test on the subsequent test 
of retention. The retention scores of 
our subjects over the two intervals 
were highly correlated (r = .79). 


Cast 


Effect of Organizers on Retention 
only 
was 


On a 3-day basis, the com- 
parative organizer effective in 
facilitating retention of the Buddhism 
material. Table 1 shows that the mean 
retention score of the total compara- 
tive group was significantly superior 
to both that of the historical group 
(p = .05) and that of the expository 
group (p = .05). However, practi- 
cally all of this obtained difference 
between the comparative group, on 
the one hand, and the expository and 
historical groups, on the other, was 
derived from the below-median sub- 
groups on the Christianity test. 
Within these below-median  sub- 
groups the differences between the 
means in question were much greater 
than the corresponding differences be- 
tween total treatment groups, and 
their level of significance was also 
correspondingly higher (p = .02, p = 
005). 

It is apparent, therefore, that al- 
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though provision of ideational scai- 
folding in the form of an expository 
organizer did not enhance retention 
of the Buddhism passage over a 3- 
day interval, the combined scaffold- 
ing and explicit discriminability ef- 
fects induced by the comparative 
organizer did significantly improve 
retention. The short-term retention 
loss in the control group was evi- 
dently small enough to preclude the 
possibility of a significant difference 
in retention attributable to the facili- 
tating effects of a simple expository 
organizer. It is true that an expository 
type of organizer significantly in- 
creased 3-day retention in an earlier 
experiment (Ausubel, 1960); but the 
learning passage used then was more 
unfamiliar to subjects, and the latter 
also had the benefit of studying the 
organizer on two separate occasions. 
As hypothesized, subjects with rela- 
tively superior knowledge of Christi- 
anity derived considerably less bene- 
fit from the comparative organizer 
than did subjects whose knowledge of 
Christianity was less impressive. This 
finding was consistent with the self- 
evident proposition that if discrimina- 
bility of a learning passage is already 
high because of endogenous factors 
within cognitive structure (i.e., be- 
cause of the clarity and stability of 
related established knowledge), less 
scope exists for the potentially facili- 
tating influence of exogenously ma- 
nipulated factors (i.e., organizers) de- 
signed to promote discriminability. 
On a 10-day basis, both the com- 
parative and expository total groups 
were significantly superior to the his- 
torical total group in retaining the 
Buddhism material (p = .02, p = 
.05), but the difference between the 
comparative and expository groups 
was negligible (see Table 1). As was 
true of the 3-day scores, however, 


most of the difference between or- 
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ganizer and control groups was de- 
rived from the below-median sub- 
groups on the Christianity test. When 
the means of just these below-median 
subgroups were compared, the signifi- 
cance level of the comparative-histor- 
ical and the expository-historical dif- 
ferences was enhanced (p = .0025, 
p < .05), and the difference between 
the comparative and _ expository 
groups was significant at the .10 level. 

In comparing the 10- to the 3-day 
retention data, it appears first, that 
only over the longer time interval was 
the natural retention loss sufficiently 
great to provide scope for the limited 
facilitating influence of the scaffold- 
ing effects available from the exposi- 
tory organizer. Second, although the 
comparative organizer was not signif- 
icantly more effective than the expos- 
itory organizer over the longer inter- 
val when the results of all subjects in 
these groups were considered, there 
was a suggestive trend in this direc- 
tion below-median sub- 
jects. 

One explanation of the relatively 
small difference in 10-day retention 
attributable to the influence of ex- 
plicit comparison per se, is the possi- 
bility that confronting the learner in 
advance with the major principles of 
Buddhism in a detail-free context 
(the expository organizer) implicitly 
increased the discriminability of his 
Buddhism ideas by enabling him to 
make his own comparisons with 
Christianity. Another plausible ex- 
planation is that by enhancing re- 
tention generally, the rehearsal effect 
induced by the 3-day Buddhism test 
had a leveling influence on the rela- 
tive degree of facilitation that might 
have been expected from the two 
kinds of organizers. This interpreta- 
tion is supported by the erosion of the 
significant retention difference be- 
tween the comparative and expository 


among the 
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— TABLE 1 
Mean RETENTION Test Scores or EXpErRi- 
MENTAL AND CONTROL GROUPS ON 
BuDDHISM 


PASSAGE 


Treatment group 
Knowledge of : : ons 
Christianity Compara- Exposi- 
tive tory or- 
organizer ganizer 


Control 
historical) 


3-day retention 
Above-median 
Below-median 
Total 
10-day retention 
Above-median 
Below-median 


Total 


22.50 
17.32 


19.91 


23.50 
20.50 
21.83 


21.79 22.27 
19.21 17.02 40 
20.31 19.65 63 


Note.—Chance score on the multiple-choice test of 
45 items is 9.0 


groups from the third to the tenth 
day 

The tendency noted above in the 
3-day results—for only the below- as 
opposed to the above-median sub- 
groups on the Christianity test to 
derive appreciable benefit from the or- 
ganizers—also appeared in the 10- 
day data. Thus, in the learning and 
retention of unfamiliar ideational ma- 
terial that is relatable to established 
concepts in the learner’s cognitive 
structure, both comparative and ex- 
pository organizers appear to be ef- 
fective only in those instances where 
existing (endogenously determined) 
discriminability between the two sets 
of ideas is inadequate as a conse- 
quence of the instability or ambig- 
uity of the established concepts. 

The special control group which 
only studied the comparative or- 
ganizer (without any exposure to the 
Buddhism passage itself) made a 
mean score of 13.20 on the 3-day 
Buddhism test and a mean score of 
13.45 on the 10-day test. These scores 
were significantly greater than the 
scores of a comparable naive group 
(which took the Buddhism tests with- 
out being exposed to either organizer 
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or learning passage), but were sub- 
stantially below those of the histori- 
cal and two organizer groups. 

It is quite unlikely, however, that 
the organizers per se directly furnished 
pertinent information enabling sub- 
jects to obtain higher scores on the 
Buddhism tests. In the first place, a 
deliberate effort was made to avoid 
providing such information in the 
two organizers. Second, if the organ- 
izers themselves had furnished useful 
information in answering test items, 
it would be difficult to explain why 
subjects in the expository group did 
not make higher scores than subjects 
in the historical group on the 3-day 
Buddhism test. Much more credible, 
therefore, is the explanation that ex- 
posure to the comparative organizer 
merely increased the general sophis- 
ticaton of subjects in the special con- 
trol group about Buddhist concepts, 
and thereby helped them to eliminate 
misleads in the multiple-choice test 
questions. Thus, they were able to ob- 
tain better than chance scores without 
studying the learning passage itself. 
But when the learning passage was 

vailable (i.e., in the historical and 
two organizer groups), subjects were 
neither benefited by the general so- 
phistication they obtained from an 
ideational organizer, nor handicapped 
by not possessing such sophistication. 


Effect of Knowledge of Christianity 
on Retention 


The data clearly support the hy- 
pothesis that the discriminability of 
the Buddhism learning material var- 
ies as a function of the clarity and 
stability of the established concepts 
to which it is related (i.e., Christian- 
ity), and hence that Buddhism reten- 
tion scores are positively correlated 
with knowledge of Christianity. Table 
1 shows that within each treatment 
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TABLE 2 


CoRRELATIONS OF BuppHISM RETENTION 
ScorEs AND OTHER MEASURES 


Buddhism retention scores 


Historical 
group 


Expository 
group 


Compara- 


Other : 
tive group 


measures 


0- 
ay 


3-day } 


3-day a 3-day ; 


Christianity .37° 21 -57°*| .42°* .66°° 
scores 
Verbal ability | .6: 75°*| .79°° .52° 
scores | 
Christianity - .40°*| .14 

scores with | 

verbal abil- | 

ity elimi- 

nated 


.56°* 


* Significant at .05 level 
** Significant at .01 level. 


group the mean retention score of the 
above-median group was significantly 
greater than the mean retention score 
of the below-median group. For the 
historical, expository, and compara- 
tive groups, these differences were 
significant at the .0005, .001, and .02 
levels, respectively, on the 3-day 
Buddhism test, and at the .0005, .0005, 
and .10 levels, respectively, on the 
10-day Buddhism test. The same 
trends are shown by the positive cor- 
relations between scores on the Bud- 
dhism and Christianity tests 
Table 2). 

It is evident, therefore, 
clearer and more stable 
knowledge of Christianty 
more discriminable this knowledge 
was from Buddhism concepts, and 
hence the higher the Buddhism reten- 
tion scores were. And conversely, the 


(see 


that the 
subjects’ 
was, the 


less clear and more unstable subjects’ 
knowledge of Christianity was, the 
less discriminable it was<érom Bud- 
dhism concepts, and the’ dower the 
Buddhism retention scores were. 

The data also confirm-the hypothe- 
sis that organizers (by virtue of their 


leveling effect on the endogenous dis- 
criminability advantage inherent in a 
clear and stable knowledge of Chris- 
tianity) reduce the relationship be- 
tween Christianity knowledge and 
Buddhism retention scores in propor- 
tion to their facilitating effect on re- 
tention. The leveling effect of the 
organizers (particularly the com- 
parative) can be seen in Table 1 by 
comparing the relative magnitude of 
the differences between above-median 
and below-median subgroups in the 
various treatment groups. For his- 
torical, expository, and comparative 
groups the respective ¢ values of these 
differences were 4.86, 3.43, and 2.24 
for the 3-day Buddhism scores, and 
4.72, 3.99, and 1.59 for the 10-day 
Buddhism scores. Correlations be- 
tween the Buddhism and Christianity 
scores show the same trend (see Table 
2). The correlation between the 
Christianity and Buddhism scores 
was higher in the historical than in 
the comparative group for both the 
3-day (p = .12) and 10-day (p = .04) 
retention intervals. The almost iden- 
tical correlations, on the other hand, 
between Christianity and 3-day Bud- 
dhism scores in the expository and 
historical groups, reflected the inef- 
fectiveness of the expository organ- 
izer in facilitating retention over the 
3-day interval. 

Because of the positive correlation 
of .44 (p < .01) between Christianity 
and SCAT however, it was 
necessary to check the alternative hy- 
pothesis that the significantly higher 
retention subjects in the 
above-median groups reflect superior 
verbal ability rather than superior 
knowledge of Christianity per se (en- 
dogenous discriminability). But sines 
the availability of only 65 SCAT 
scores made it impossible to match for 
verbal ability those subjects within 


scores, 


scores of 


each treatment group who were above 
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and below the median score on the 
Christianity test, it was necessary to 
resort to partial correlation. 

The partial correlations between 
the Buddhism and Christianity 
scores, with the effect of verbal abil- 
ity eliminated, are shown for all three 
groups in Table 2. For the historical 
group the partial correlations of .40 
and .43 (for the 3- and 10-day scores, 
respectively), although lower than the 
corresponding simple correlations of 
.55 and .56 were still significant at the 
.01 level. Three of the four other partial 
correlations, however, were negligible 
and nonsignificant, indicating that 
the corresponding simple correlations 
largely reflected the positive rela- 
tionship between verbal ability and 
Buddhism retention scores. The in- 
trinsic residual relationship between 
knowledge of Christianity and reten- 
tion of the Buddhism material, after 
the effect of verbal ability was elimi- 
nated, was actually close to zero in 
these instances, because of the level- 


ing influence of the organizers on the 


endogenous discriminability advan- 
tage conferred by superior knowledge 
of Christianity. The partial correla- 
tion between the Christianity and 
3-day Buddhism scores remained 
significant at the .01 level in the ex- 
pository group, in as much as the ex- 
pository organizer did not facilitate 
retention over the 3-day interval. 
Intergroup comparison of the par- 
tial correlations in Table 2 shows 
even more clearly than does corre- 
sponding comparison of the simple cor- 
relations between Buddhism and 
Christianity scores, that the organ- 
izers (in proportion to their facili- 
tating effect on retention) reduced 
the significant relationship between 
knowledge of Christianity and reten- 
tion of the Buddhism material. With 
the influence of verbal ability elimi- 
nated, the partial correlation between 


Christianity and 3-day Buddhism 
scores in both the historical and ex- 
pository groups was significantly 
higher than in the comparative group 
(p = .05, p = .05). The partial corre- 
lation between Christianity and 10- 
day Buddhism scores in the historical! 
group was higher than the corre- 
sponding partial correlations in the 
expository (p = .08) and comparative 
(p = .01) groups. In effect then, by 
being provided with a given type of 
discriminability aid (organizer), sub- 
jects possessing relatively little 
knowledge of Christianity (and hence 
little endogenous discriminability) 
were placed on approximately the 
same footing with respect to the dis- 
criminability variable and its effect 
on retention, as subjects possessing 
greater knowledge of Christianity 
(and greater endogenous discrimi- 
nability). 

Table 2 also shows that the corre- 
lation between verbal ability and 
Buddhism retention scores in the his- 
torical group (where the relationship 
was not influenced by interaction with 
organizer effects) was approximately 
the same as that between Christianity 
and Buddhism scores. But unlike the 
latter relationship, which was at- 
tenuated by interaction with the or- 
ganizers, the correlation between ver- 
bal ability and Buddhism scores was 
slightly higher in the comparative 
than in the historical group, and sug- 
gestively but not significantly higher 
in the expository than in the historical 
group (p = .17, p = .07). At the very 
least, therefore, it is definite that 
neither organizer detracted from the 
strong positive relationship between 
verbal ability and the retention of the 
Buddhism material; and there was a 
suggestive tendency for verbal ability 
to have an even greater impact on the 
retention of the Buddhism passage 
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when subjects were given the benefit 
of an expository organizer. 


SUMMARY AND CONCLUSIONS 

This experiment was concerned 
with the role of endogenous and ex- 
ternally manipulated discriminability 
in the learning and retention of un- 
familiar ideational material (Bud- 
dhism) that was relatable to previ- 
ously learned concepts (Christianity) 
already established in cognitive struc- 
ture. 

The learning task consisted of a 
2,500-word passage on the principles 
of Buddhism. Two days before study- 
ing this learning passage, one experi- 
mental group studied a 500-word 
comparative organizer explicitly com- 
paring the major ideas of Buddhism 
and Christianity. Another experimen- 
tal group studied an expository or- 
ganizer which made no reference to 
Christianity. A control group studied 
an historical introduction dealing 
with the history rather than with the 
ideas of Buddhism. Retention of the 
Buddhism material was tested 3 and 
10 days after the learning session by 
means of equivalent forms of a multi- 
ple-choice test. For purposes of anal- 
ysis, subjects in the various treatment 
groups (university undergraduates) 
were divided into above- and below- 
median subgroups in terms of their 
scores on an objective test of Christi- 
anity. 

Subjects with greater knowledge 
of Christianity made significantly 
higher scores on the Buddhism reten- 
tion test than did subjects with less 
knowledge of Christianity. This sig- 


nificantly positive relationship be- 
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tween Christianity and Buddhism test 
scores held up even when the effect of 
verbal ability was eliminated. Hence 
the data support the hypothesis that 
the learning and retention of unfamil- 
iar verbal material varies positively 
with its discriminability from related, 
previous learned concepts established 
in cognitive structure, and that this 
endogenously determined discrimi- 
nability is a function of the clarity and 
stability of the latter concepts. 

On a 3-day basis only the compara- 
tive organizer was significantly effec- 
tive in facilitating the retention of the 
Buddhism material, but over a 10-day 
interval both comparative and exposi- 
tory organizers were significantly ef- 
fective. These facilitating effects of 
the organizers on retention outcomes, 
however, only applied to subjects in 
the below-median subgroups on the 
Christianity test. Thus in the learning 
and retention of unfamiliar ideational 
material that is relatable to estab- 
lished concepts in the learner’s cogni- 
tive structure, both comparative and 
expository organizers appear to be 
effective only in those instances where 
discriminability between the 
of ideas is inadequate as a 


existin 


ig 
two sets 
consequence of the instability or am- 
biguity of established concepts. 
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